scrape box,Harvesting is gone,Is it?
- Thread starter masush300
- Start date
angelas111
Elite Member
- Jan 4, 2009
- 1,648
- 1,052
if you disabled proxies then your home ip probably got banned really fast. you need some more proxies and it will work.
directaxcess
Senior Member
- Sep 12, 2011
- 825
- 158
You need quality public proxies to be able to scrape from Google -- I've been having the same issues lately and probably going to invest into semi-private proxies to scrape from Google as public ones aren't working as well for me anymore.
I've been harvesting a very large list for the past 24 hours and its still chugging along. So definitely no problem.
I suggest getting some private proxies and setting your maximum connections to 20% of your total proxies. 10 private proxies > 2 max connections. Will scrape slower but more consistent without getting your all your ip's blocked.
I suggest getting some private proxies and setting your maximum connections to 20% of your total proxies. 10 private proxies > 2 max connections. Will scrape slower but more consistent without getting your all your ip's blocked.
partymarty4870
Elite Member
- Jul 7, 2010
- 2,032
- 1,697
I got YPP to change my proxies 3 times this month (in 1 day) to fix this problem. I'm probably the reason they are now just refunding.
worldwebsolutions
Regular Member
- Feb 3, 2010
- 377
- 16
its working for me fine, try without proxies to see if it is working
mikehamm0n
Newbie
- Oct 26, 2010
- 3
- 1
I've not been able to get results from Bing for the past two days. Google is working fine, but Bing scraping harvests nothing. I tried numerous different proxies, a direct connection, with and without their search operators... Yahoo and AOL work for me as well.
ibmethatswhoib
Elite Member
- Feb 17, 2011
- 1,567
- 1,171
I tried all those above and the problem I found at least for me, you have to put in more keywords to scrape than before. If I only put a few keywords I don't get many connections and it dies out, didn't use to do that for me but ya that fixed it for me.
directaxcess
Senior Member
- Sep 12, 2011
- 825
- 158
That's because if Google is getting requests for ONE keyword from a bunch of different proxies, they will ban the proxies very fast -- so yes, this is a decent solution to the problem.
