- Jan 25, 2009
- 6,378
- 3,774
Scraping Google : how many requests /minute ?
- Thread starter Arold79
- Start date
okaeuka
Newbie
- Sep 29, 2010
- 14
- 3
Scraping Google depends on how You sen requests to Google Search - if logged to google or not, if use cookies or not, what is time interval between queries and much more.
We can assume that it's around 30 requests and your IP is temporary blocked (unblock by solve recaptcha2).
We can assume that it's around 30 requests and your IP is temporary blocked (unblock by solve recaptcha2).
- Jan 25, 2009
- 6,378
- 3,774
Its not about quantity of requests. Its about quantity of requests in a given time frame. I probably search google more then 30 times on a busy day in my browser, thats normal, even 30 times an hour would not be abnormal, so 30 requests in X time.
But it varies based on your block history with google and if javascript is on or off, further if varies based on the subnet and possibly its history with google, the ip type, and the list goes on.
nemsis
Junior Member
- Sep 27, 2009
- 197
- 294
I've just read this about scraping google https://medium.com/brisk-voyage/how-we-scrape-300k-flight-prices-per-day-from-google-flights-79f5ddbdc4c0
It's funny, they seem to be scared with their 25k pages/day while people here are sending 200 reqs/second with scrapebox and such ^^"
It's funny, they seem to be scared with their 25k pages/day while people here are sending 200 reqs/second with scrapebox and such ^^"