Have I successfully bypassed Google's scraping detection?

I've been scraping Google using 20 proxies for about 4 days straight taking precautions not too use each proxy too much or too often. Normally, if I use a bad proxy, I get blocked within the first 30 minutes. Am I in the clear now or does Google have multiple layers of detection, some of which don't kick in until days later?

I don't know exact amounts how many requests a single IP can do before it will be temp. banned. How many requests you have done per IP approx.? You can try it simply by using one IP and see many requests you can do before it will get blocked.

I need to query google for my own purposes but im using about 100 clean proxy randomly, haven't experienced yet issues.

PS. I don't think so you have bypassed anything, you just did not scraped too much.

Hello,

Some info about scraping :


Remove _

ricardo_bresil: Thanks. Interesting. I hadn't read that but it is almost exactly what I'm doing except that the minimum wait time is a little less for me. I will save the article nevertheless.

NIXMY: The algorithm I use allows each proxy to act independently. It doesn't matter if I have 1 or 100, each individual proxy searches differently and at different times. I've tried the test with 1 proxy and with 20 proxies and both have worked well. The only way that I can see a proxy being affected by other proxies is if they are in the same subnet. I have 20 proxies and five different subnets. It seems that is enough subnets...for now. BTW I'm not allowing each proxy to be used more than 500 times in 24 hours and I'm waiting at least 15 seconds before a proxy is used again.

So the questions still remains: I am in the clear after 4 days of not being blocked?

Just be human.

Beny

kokoloko75 said:

Just be human.

Beny

Click to expand...

haaaaaaaahha what a saying