Originally Posted By: m179

BUMP
It's been 3 days of trying to get it to work and still no success, please help!

Hi,

I don't have a box configured for IPv6 to test. I do most of my development on Macs which
seem to have problems doing DNS AAAA records (IPv6 works okay for direct addresses
just not name look up). At some point I will get around to
testing stuff on my Linux machine which should work okay, but I am not sure on a time
frame for this, maybe a week or two.

Best,
Chris

Originally Posted By: m179

cpollett wrote:
Hi,

I don't have a box configured for IPv6 to test. I do most of my development on Macs which
seem to have problems doing DNS AAAA records (IPv6 works okay for direct addresses
just not name look up). At some point I will get around to
testing stuff on my Linux machine which should work okay, but I am not sure on a time
frame for this, maybe a week or two.

Best,
Chris


Hi,
Can you suggest a file for me to look at and possible edit/add something to in the source code to Yioop so that it can resolve AAAA records from domains?
The sooner I can get this up and running the better!

Also, I can setup very easily a free linux box (VPS) for you to test if you want. I don't mind at all and if it helps the project's development, even better!
Thanks,
Michael

The two functions used to download pages are in lib/fetch_url.php (getPages and getPage). My guess is that what is needed is to add the curl_setopt to resolve ipv6. There might also be a problem with the was Yioop does DNS caching. If this is the case it will probably start to work for the robots.txt download after adding the curl_setopt, but not subsequent downloads from a site.

Originally Posted By: m179

cpollett wrote:
The two functions used to download pages are in lib/fetch_url.php (getPages and getPage). My guess is that what is needed is to add the curl_setopt to resolve ipv6. There might also be a problem with the was Yioop does DNS caching. If this is the case it will probably start to work for the robots.txt download after adding the curl_setopt, but not subsequent downloads from a site.


SOLVED!
All I had to do was change this line:
Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_V4);

to this:
Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_V6);

BUT you can also change it to this which lets it resolve IPv4 address AND IPv6 address:
Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_WHATEVER);

Originally Posted By: m179

Hello,
Trying to get Yioop to work with IPv6 so what I do it since I want it to only index certain domains, I put the configuration like this ( http://puu.sh/6m9h4/d8533f2c19.png ) however in the logs, I see it is not working and "Total URLs Seen" stays at 0.

I can ping the URL from the machine and it responds just fine.

Error from logs:
Code: [Wed, 15 Jan 2014 12:44:12 -0800] http://socialno.de/robots.txt response code Couldn't resolve host 'socialno.de'
[Wed, 15 Jan 2014 12:44:12 -0800] No page processor for mime type:
[Wed, 15 Jan 2014 12:44:12 -0800] Not processing: http://socialno.de/robots.txt
[Wed, 15 Jan 2014 12:44:12 -0800] http://urlcloud.net/robots.txt response code Couldn't resolve host 'urlcloud.net'
[Wed, 15 Jan 2014 12:44:12 -0800] No page processor for mime type:
[Wed, 15 Jan 2014 12:44:12 -0800] Not processing: http://urlcloud.net/robots.txt

Please assist as I want to get Yioop working ASAP with IPv6 indexing.
Thanks!
Mike

Cool. I've changed that line in my development copy. Let me know if there are any other issues.

Best,
Chris