webguy2000
Power Member
- May 8, 2018
- 577
- 260
I used to be able to use one proxy to scrape about 200 public profiles per hour, now when I use the same proxy I get errors like "Error Please wait a few minutes before you try again." or "too many requests".
I have tried dropping my limits to 1 request per MINUTE, and after about 215 profiles it got blocked again.
Does anyone have experience with scraping profiles without getting blocked, if so, what is your hourly/daily limit? What kind of proxy are you using? What kind of user agent are you sending?
I have tried dropping my limits to 1 request per MINUTE, and after about 215 profiles it got blocked again.
Does anyone have experience with scraping profiles without getting blocked, if so, what is your hourly/daily limit? What kind of proxy are you using? What kind of user agent are you sending?