why do people say to harvest with private proxies? Ive just bought 10 proxies set my connections to as low as 1 and ive only scraped 50,000 urls and half are blocked already. This is a catch 22! I use public ones and there all crap,i buy private ones and they all get blocked. I hear of other people saying they scraped a million results the most ive got up to is 100,000 this is really annoying!