Quote:
Originally Posted by kurotenshi
Answering to your quesition on the board in private.. but due to the wine I posted it in public :P
When I try with 10 pages, the first search works fine. With 100 pages it pretty much stops after 10. I can see that google is giving me a captcha and thats where it halts. I am located in XXXX and it seems like it chooses google site according to your IP-address as the messages I have in the TEMP-file is in XXXX. Wont bother to start trying from other IP-addresses (read other countries) at the moment because it seems strange to me that lets say google.jp or google.com should have other search rules/criterias. Counting it a bit roughly I havent been able to download more then about 200 addresses.
|
Okay cool. Maybe a proxy rotator is the answer then. Thank you so much for your insight. I don't mind it being public so long as I can read it