Scrapebox detailed harvester 80k urls

Paatu

Newbie
Joined
Apr 12, 2013
Messages
25
Reaction score
0
How to scrape 80k urls with Scrapebox detailed harvester ?Maybe impossible task ?

I have tried with 30 private proxies but most of them starts failing after few hours. :(

( detailed harvester takes only the goolge 1st result per keyword )
 
try scrapbox with vps and good proxies then it will do
 
Tweak your settings. And what is with the "detailed harvester takes only the goolge 1st result per keyword" ?
You should check your footprints and keywords. Some might have low results in google.
 
Make sure the "results" box on the main Scrapebox window in the lower left hand corner is set to 1000 and not like 1. If its only taking the first result then that is likely why

Also you can add a delay in custom harvester, as if the ips are getting blocked that will slow it down a bit more. Scraping 80K results is no problem at all, but you need to have everything else set appropriately as well as have it slow enough or enough proxies so they don't get blocked. but adding more results will make it work better as its pulling 100 results per page and dumping the other 99 if you have it set to only pull 1 result.
 
Back
Top