View Single Post
  #10 (permalink)  
Old 06-11-2008, 07:28 PM
oldenstylehats's Avatar
oldenstylehats oldenstylehats is offline
trophaeum's bitch
 
Join Date: Apr 2008
Posts: 1,895
Thanks: 630
Thanked 1,171 Times in 436 Posts
Reputation: 60
iTrader: (0)
Default Re: Simple Email Scraper - Mac OS X 10.4 and greater

Quote:
Originally Posted by kurotenshi View Post
Answering to your quesition on the board in private.. but due to the wine I posted it in public :P

When I try with 10 pages, the first search works fine. With 100 pages it pretty much stops after 10. I can see that google is giving me a captcha and thats where it halts. I am located in XXXX and it seems like it chooses google site according to your IP-address as the messages I have in the TEMP-file is in XXXX. Wont bother to start trying from other IP-addresses (read other countries) at the moment because it seems strange to me that lets say google.jp or google.com should have other search rules/criterias. Counting it a bit roughly I havent been able to download more then about 200 addresses.
Okay cool. Maybe a proxy rotator is the answer then. Thank you so much for your insight. I don't mind it being public so long as I can read it
Reply With Quote