2013-12-15

Dumb Question.

Originally Posted By: blackbeak
I have Yioop set-up and running on my local mac osx.

Is there a simple step by step guide about how now to conduct a search and start indexing pages?
I have done 3 or 4 crawls but they all return the same pages (mainly robot.txt files) so presumably I am doing something wrong. I don't see anywhere to input a simple search query?

Thanks,
Steve
'''Originally Posted By: blackbeak''' I have Yioop set-up and running on my local mac osx.<br><br>Is there a simple step by step guide about how now to conduct a search and start indexing pages?<br>I have done 3 or 4 crawls but they all return the same pages (mainly robot.txt files) so presumably I am doing something wrong. I don't see anywhere to input a simple search query? <br><br>Thanks,<br>Steve

-- Dumb Question
So you tried one of the install guides:
http://www.seekquarry.com/?c=main&p=install
but need more info on the performing a simple crawl
step?

If you click on your instance's Yioop logo, it will take
you to the landing page where you can enter a query.

If you managed to index anything, then the queries:
site:any
or
site:all
would return it.
So you tried one of the install guides:<br>http://www.seekquarry.com/?c=main&p=install<br>but need more info on the performing a simple crawl<br>step? <br><br>If you click on your instance's Yioop logo, it will take<br>you to the landing page where you can enter a query.<br><br>If you managed to index anything, then the queries:<br>site:any<br>or<br>site:all<br>would return it.

-- Dumb Question
Originally Posted By: blackbeak
So is the point of the search engine to index the entire web and then segment the data afterwards?
'''Originally Posted By: blackbeak''' So is the point of the search engine to index the entire web and then segment the data afterwards?

-- Dumb Question
Originally Posted By: blackbeak
And yes, I installed it ok on my local machine. However I'd assumed that the crawl step is configurable.

So if I wanted to index only for instance all sites that have something to do with a particular topic I would be able to do so. The crawls I succeeded with seemed to be indexing everything but I couldn't see a way to add a keyphrase as a filter. Like I say it might be a dumb question?
'''Originally Posted By: blackbeak''' And yes, I installed it ok on my local machine. However I'd assumed that the crawl step is configurable. <br><br>So if I wanted to index only for instance all sites that have something to do with a particular topic I would be able to do so. The crawls I succeeded with seemed to be indexing everything but I couldn't see a way to add a keyphrase as a filter. Like I say it might be a dumb question?
2013-12-17

-- Dumb Question
Manage Crawls -> Options has forms that allow you to control what pages are crawled. i.e.,
things link the initial seed sites.

Page Options -> Crawl Time tab has a form that allows you to control file types crawled
as well as how pages should be crawled. i.e., things like the maximum number of bytes
downloaded, how to extract a summary from a page, etc. One of things you can select
on this page is which indexing plugins to use. The Word Filter Plugin allows you
to control how to process a page based on the words it contains. You can look
within the Yioop documentation to see the format for its configure page.

Best,
Chris
Manage Crawls -&gt; Options has forms that allow you to control what pages are crawled. i.e.,<br>things link the initial seed sites.<br><br>Page Options -&gt; Crawl Time tab has a form that allows you to control file types crawled<br>as well as how pages should be crawled. i.e., things like the maximum number of bytes<br>downloaded, how to extract a summary from a page, etc. One of things you can select<br>on this page is which indexing plugins to use. The Word Filter Plugin allows you<br>to control how to process a page based on the words it contains. You can look<br>within the Yioop documentation to see the format for its configure page.<br><br>Best,<br>Chris
X