I'm using 12 dedicated private Ip's with scrpaebox. after setting the software on the most optimal settings
I was able to scrape 20K URL's with 30KW's before my list died (google ban). what setup will help me run smoother and scrape more url's?
Also, what other engine should I look into that'll give me good results and is less secured against bots?
Scrapebox settings-
Harvester connections : 1
Results : 500
Delay: 10sec
Platform: Wordpress
Search Engine: Google
I was able to scrape 20K URL's with 30KW's before my list died (google ban). what setup will help me run smoother and scrape more url's?
Also, what other engine should I look into that'll give me good results and is less secured against bots?
Scrapebox settings-
Harvester connections : 1
Results : 500
Delay: 10sec
Platform: Wordpress
Search Engine: Google