Size: 1006156 pages/17366761 urls

Yioop did a three day crawl, then stopped. When I did a random search, I got error messages saying disk full, among other things. Then I found I could not log in anymore and had to restart the server. It them lets me log in and the error messages disappear, but an hour or so later again I can't log in and the error messages appear again. These are the results of the crawl so far: Size: 1006156 pages/17366761 urls I have a 2TB disk and 4GB DDR2 Apart from Ubuntu, there's nohing else running on my server but the disk is indeed full, does this seem right? If so what size disk did you use to attain a billion pages?

-- Disk full after 3 day crawl

Hi Yiphy, The crawl itself wouldn't be that big. I have seen it happen that a linux system and a hard drive don't play nice with each other, and so you get a ton of log messages/errors which fill up a hard drive. You can look around in /var/log to see if there are any large files. Best, Chris

-- Disk full after 3 day crawl

Thanks for your help Chris. The problem wasn't with Yioop but with my server. I don't quite understand it, it's a 2TB server but including partitions it was full at 21Gb. I had to do a total re-installation, O/S included! Still it's back up and running and Yioop has been installed again. It's a really interesting search engine and it's going to take a bit of time to fully understand it, but it's certainly worth it. I wonder if there is a demo for the ad script? Thanks again.

-- Disk full after 3 day crawl

The ad script is running on findcan.ca. Search on anything. If no one has advertised for that topic yet, it defaults to the advertise with us advertisement. Click on that link and it will explain how to purchase an ad. Best, Chris