Yioop - PHP Search Engine

-- indexing problem

Commit a4199af6 tries to fix this issue. It can be downloaded from
http://www.seekquarry.com/viewgit/?a=ar ... 046b&t=zip

Best,
Chris

Commit a4199af6 tries to fix this issue. It can be downloaded from http://www.seekquarry.com/viewgit/?a=ar ... 046b&t=zip Best, Chris

-- indexing problem

Originally Posted By: andreab82

Hey Chris,

I've done what you asked.
I started the "queue_server" and then the "fetcher" in different windows.
After that (without adding any machine through the web interface) I started a crawl.

The "fetcher" process died.
You can see the "fetcher" log here: http://pastebin.com/ncqLLtae

Hope it helps.

Regards,
Andrea

'''Originally Posted By: andreab82''' Hey Chris, I've done what you asked. I started the "queue_server" and then the "fetcher" in different windows. After that (without adding any machine through the web interface) I started a crawl. The "fetcher" process died. You can see the "fetcher" log here: http://pastebin.com/ncqLLtae Hope it helps. Regards, Andrea

-- indexing problem

Did you get the version above before doing this test?

-- indexing problem

Originally Posted By: andreab82

No, I had tried with the v0.98.

Now, I tried with that version above and it doesn't hang anymore...

It has now been running for 6/7 hours with one queue_server and two fetchers and no problems.

The possible issue I realized is that the apache error log is 1.4GB!!!
It currently contains 30140038 lines of errors!
30 millions! :-/

This didn't happen with Ubuntu 12.04.

I can't possibly upload the whole error log but I've pasted here some of it: http://pastebin.com/kGqg0W2t
It's mostly repetitive.

Hope it helps.
Andrea

'''Originally Posted By: andreab82''' No, I had tried with the v0.98. Now, I tried with that version above and it doesn't hang anymore... It has now been running for 6/7 hours with one queue_server and two fetchers and no problems. The possible issue I realized is that the apache error log is 1.4GB!!! It currently contains 30140038 lines of errors! 30 millions! :-/ This didn't happen with Ubuntu 12.04. I can't possibly upload the whole error log but I've pasted here some of it: http://pastebin.com/kGqg0W2t It's mostly repetitive. Hope it helps. Andrea

-- indexing problem

Hmm. That's weird. I'll try to recreate it. The errors seem to be just the
verbose mode data from curl. I'll try to figure out why its being captured
by the apache error_log. In case you wondering, I'm using 12.04 LTS
so i hadn't run into this issue. My testing on this is vm-based.

Best,
Chris

Hmm. That's weird. I'll try to recreate it. The errors seem to be just the verbose mode data from curl. I'll try to figure out why its being captured by the apache error_log. In case you wondering, I'm using 12.04 LTS so i hadn't run into this issue. My testing on this is vm-based. Best, Chris

-- indexing problem

Originally Posted By: andreab82

To be honest, I'm happy to stick to Ubuntu 12.04 too. I was just reporting the issues I've had with Debian...
I'm running various VMs anyway.

Cheers,
Andrea

'''Originally Posted By: andreab82''' To be honest, I'm happy to stick to Ubuntu 12.04 too. I was just reporting the issues I've had with Debian... I'm running various VMs anyway. Cheers, Andrea