Google detect footprints and ban proxies. How do you scrape these days?

Penumbra

Senior Member
Joined
Apr 23, 2014
Messages
828
Reaction score
245
I tried first with gsa ser footprints, then tried some custom ones, but scrapebox wont scrape at all, google detects it and block it. I tried elite google passed proxies, then 250 backconnect proxies that change every 10 minutes but still same, what you are doing to avoid this problem, and problem is without doubt footprints.
 

TheGypsy

Registered Member
Joined
Aug 15, 2014
Messages
70
Reaction score
21
You may try to lower your scraping threads or increase the number of proxies for your thread. I haven't used private proxies for a while now for scraping but I saw people recommending a bunch of proxies per thread. Some proxy providers even state that their proxies aren't for scraping anymore, you may check the small print in their ToS page.
 

SuperLinks

Elite Member
Joined
Jul 14, 2008
Messages
2,903
Reaction score
852
Scraping sure is tougher than it used to be so I'd love to hear feedback on what others are doing that works.

Personally I've got a few different VPS's and have my delay's set very high and run it nearly around the clock without problems. The main issue though is it's not producing quick results.
 

skyflash

Regular Member
Joined
Jan 28, 2014
Messages
320
Reaction score
56
Google blocks IPs temporary and only if it detects spammy activities, may be you can try virgin fully dedicated proxies.
 

FireSoftLimited

Junior Member
Joined
Apr 27, 2013
Messages
119
Reaction score
25
That is really bad news as I wanted to ask about good proxy footprints for ahref for 2015 :/ (I have to start doing some SEO again and after 3 years break).

What kind of waiting time are we talking about (between loading next result page for IP) ? 10-90 seconds ?
 
Top