Is scrapebox harvesting ment to take this long?

majikz10

Registered Member
Joined
Jul 3, 2012
Messages
82
Reaction score
5
Im harvesting 190 keywords on google,yahoo and aol with 216 public proxies.It taken 88mins to harvest 40,000 urls.
 
it is too much, have you used the multi-threaded harvester??

or maybe the proxies were very slow
 
Depends on internet bandwidth, proxy speed and your PC or servers CPU speed and RAM.

Mind you with public proxies I'm surprised the task even finished. In 88 minutes chances are by the time you finish it about 90% of them will be dead.
It will have spent most of the time squeezing results through just a handful of proxies.

Cheap - sure - but public proxies are very slow and unreliable. So 88,000 results in that time frame seems a fare return for next to zero financial outlay.
I do between 5000 and 25,000 keywords and it can take between 24 and 72 hours through 80 private proxies but only 8 running threads (but that's 25,000 keywords - not 190)

Scritty
 
How many connections are you using ?
I recommend you to invest in minimum 10 private proxies and use about 3-4 connections with them. You will see some nice results. ;)
 
It's too slow buddy!! Increase your connections to 10-15. But if you're running on a slow connection then you can't help it. It'll take some time. I'm usually able to harvest 20-30k links in 1-2 minutes with 200 odd public proxies. I only use google passed fast public proxies.

Thanks
 
Depends on internet bandwidth, proxy speed and your PC or servers CPU speed and RAM.

Mind you with public proxies I'm surprised the task even finished. In 88 minutes chances are by the time you finish it about 90% of them will be dead.
It will have spent most of the time squeezing results through just a handful of proxies.

Cheap - sure - but public proxies are very slow and unreliable. So 88,000 results in that time frame seems a fare return for next to zero financial outlay.
I do between 5000 and 25,000 keywords and it can take between 24 and 72 hours through 80 private proxies but only 8 running threads (but that's 25,000 keywords - not 190)

Scritty

Wow cheers ive got it.
 
How many connections are you using ?
I recommend you to invest in minimum 10 private proxies and use about 3-4 connections with them. You will see some nice results. ;)

yh i dont have a problem with buying 10 or 20 private proxies but ive read loads they will burn out fast and get banned.I only need to harvest at the moment.An im not sure about all the speeds im using bhs vps.Cheers
 
How many connections are you using ?
I recommend you to invest in minimum 10 private proxies and use about 3-4 connections with them. You will see some nice results. ;)

Thank You alaltaierii, too many posts on not using private proxies
for harvesting. It's time to break this myth, this is so much more
efficient.
 
Back
Top