-- Yioop could be use on a large scale ???
If under Manage Machines you add a mirror for a queue server, it will load balance between the machines.
Yioop can probably handle crawl sizes up to 3-4 billion pages without too much difficulty. I have only ever tested up to 1 billion pages. As for queries/second that is contingent on a number of factors. If you were in such a situation you could make it scale via mirroring.
If under Manage Machines you add a mirror for a queue server, it will load balance between the machines.
Yioop can probably handle crawl sizes up to 3-4 billion pages without too much difficulty. I have only ever tested up to 1 billion pages. As for queries/second that is contingent on a number of factors. If you were in such a situation you could make it scale via mirroring.