Hijacking!
I'm using 25 proxies and wtih 60 sec delay in the harvester engine settings I still can't scrape more than about 15-20k urls before everything gets blocked. (I use 1 thread) Any suggestions on what to do? buy 25 more or can I adjust it in any other way?