2014-01-17

Re: IPv6 Not Working.

Originally Posted By: m179
BUMP
It's been 3 days of trying to get it to work and still no success, please help!
'''Originally Posted By: m179''' BUMP<br>It's been 3 days of trying to get it to work and still no success, please help!

-- IPv6 Not Working
Hi,

I don't have a box configured for IPv6 to test. I do most of my development on Macs which
seem to have problems doing DNS AAAA records (IPv6 works okay for direct addresses
just not name look up). At some point I will get around to
testing stuff on my Linux machine which should work okay, but I am not sure on a time
frame for this, maybe a week or two.

Best,
Chris
Hi,<br><br>I don't have a box configured for IPv6 to test. I do most of my development on Macs which<br>seem to have problems doing DNS AAAA records (IPv6 works okay for direct addresses<br>just not name look up). At some point I will get around to<br>testing stuff on my Linux machine which should work okay, but I am not sure on a time<br>frame for this, maybe a week or two.<br><br>Best,<br>Chris

-- IPv6 Not Working
Originally Posted By: m179
cpollett wrote:
Hi,

I don't have a box configured for IPv6 to test. I do most of my development on Macs which
seem to have problems doing DNS AAAA records (IPv6 works okay for direct addresses
just not name look up). At some point I will get around to
testing stuff on my Linux machine which should work okay, but I am not sure on a time
frame for this, maybe a week or two.

Best,
Chris


Hi,
Can you suggest a file for me to look at and possible edit/add something to in the source code to Yioop so that it can resolve AAAA records from domains?
The sooner I can get this up and running the better!

Also, I can setup very easily a free linux box (VPS) for you to test if you want. I don't mind at all and if it helps the project's development, even better!
Thanks,
Michael
'''Originally Posted By: m179''' cpollett wrote:<br>Hi,<br><br>I don't have a box configured for IPv6 to test. I do most of my development on Macs which<br>seem to have problems doing DNS AAAA records (IPv6 works okay for direct addresses<br>just not name look up). At some point I will get around to<br>testing stuff on my Linux machine which should work okay, but I am not sure on a time<br>frame for this, maybe a week or two.<br><br>Best,<br>Chris<br><br><br>Hi,<br>Can you suggest a file for me to look at and possible edit/add something to in the source code to Yioop so that it can resolve AAAA records from domains?<br>The sooner I can get this up and running the better!<br><br>Also, I can setup very easily a free linux box (VPS) for you to test if you want. I don't mind at all and if it helps the project's development, even better!<br>Thanks,<br>Michael

-- IPv6 Not Working
The two functions used to download pages are in lib/fetch_url.php (getPages and getPage). My guess is that what is needed is to add the curl_setopt to resolve ipv6. There might also be a problem with the was Yioop does DNS caching. If this is the case it will probably start to work for the robots.txt download after adding the curl_setopt, but not subsequent downloads from a site.
The two functions used to download pages are in lib/fetch_url.php (getPages and getPage). My guess is that what is needed is to add the curl_setopt to resolve ipv6. There might also be a problem with the was Yioop does DNS caching. If this is the case it will probably start to work for the robots.txt download after adding the curl_setopt, but not subsequent downloads from a site.

-- IPv6 Not Working
Originally Posted By: m179
cpollett wrote:
The two functions used to download pages are in lib/fetch_url.php (getPages and getPage). My guess is that what is needed is to add the curl_setopt to resolve ipv6. There might also be a problem with the was Yioop does DNS caching. If this is the case it will probably start to work for the robots.txt download after adding the curl_setopt, but not subsequent downloads from a site.


SOLVED!
All I had to do was change this line:
Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_V4);

to this:
Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_V6);

BUT you can also change it to this which lets it resolve IPv4 address AND IPv6 address:
Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_WHATEVER);
'''Originally Posted By: m179''' cpollett wrote:<br>The two functions used to download pages are in lib/fetch_url.php (getPages and getPage). My guess is that what is needed is to add the curl_setopt to resolve ipv6. There might also be a problem with the was Yioop does DNS caching. If this is the case it will probably start to work for the robots.txt download after adding the curl_setopt, but not subsequent downloads from a site.<br><br><br>SOLVED!<br>All I had to do was change this line:<br>Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_V4);<br><br>to this:<br>Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_V6);<br><br>BUT you can also change it to this which lets it resolve IPv4 address AND IPv6 address:<br>Code: curl_setopt($sites[$i][0], CURLOPT_IPRESOLVE, CURL_IPRESOLVE_WHATEVER);

SOLVED: IPv6 Not Working
Originally Posted By: m179
Hello,
Trying to get Yioop to work with IPv6 so what I do it since I want it to only index certain domains, I put the configuration like this ( http://puu.sh/6m9h4/d8533f2c19.png ) however in the logs, I see it is not working and "Total URLs Seen" stays at 0.

I can ping the URL from the machine and it responds just fine.

Error from logs:
Code: [Wed, 15 Jan 2014 12:44:12 -0800] http://socialno.de/robots.txt response code Couldn't resolve host 'socialno.de'
[Wed, 15 Jan 2014 12:44:12 -0800] No page processor for mime type:
[Wed, 15 Jan 2014 12:44:12 -0800] Not processing: http://socialno.de/robots.txt
[Wed, 15 Jan 2014 12:44:12 -0800] http://urlcloud.net/robots.txt response code Couldn't resolve host 'urlcloud.net'
[Wed, 15 Jan 2014 12:44:12 -0800] No page processor for mime type:
[Wed, 15 Jan 2014 12:44:12 -0800] Not processing: http://urlcloud.net/robots.txt

Please assist as I want to get Yioop working ASAP with IPv6 indexing.
Thanks!
Mike
'''Originally Posted By: m179''' Hello,<br>Trying to get Yioop to work with IPv6 so what I do it since I want it to only index certain domains, I put the configuration like this ( http://puu.sh/6m9h4/d8533f2c19.png ) however in the logs, I see it is not working and &quot;Total URLs Seen&quot; stays at 0.<br><br>I can ping the URL from the machine and it responds just fine.<br><br>Error from logs:<br>Code: [Wed, 15 Jan 2014 12:44:12 -0800] http://socialno.de/robots.txt response code Couldn't resolve host 'socialno.de'<br>[Wed, 15 Jan 2014 12:44:12 -0800] No page processor for mime type: <br>[Wed, 15 Jan 2014 12:44:12 -0800] Not processing: http://socialno.de/robots.txt<br>[Wed, 15 Jan 2014 12:44:12 -0800] http://urlcloud.net/robots.txt response code Couldn't resolve host 'urlcloud.net'<br>[Wed, 15 Jan 2014 12:44:12 -0800] No page processor for mime type: <br>[Wed, 15 Jan 2014 12:44:12 -0800] Not processing: http://urlcloud.net/robots.txt<br><br>Please assist as I want to get Yioop working ASAP with IPv6 indexing.<br>Thanks!<br>Mike

-- SOLVED: IPv6 Not Working
Cool. I've changed that line in my development copy. Let me know if there are any other issues.

Best,
Chris
Cool. I've changed that line in my development copy. Let me know if there are any other issues.<br><br>Best,<br>Chris
X