how do u scrape massive list of url using scrapebox?

lmaestro

Power Member

Jan 28, 2011

667

230

• May 24, 2011

• #1

how many keywods and proxies do u use.im using 10 private proxies and 2k keywords and can only harvest 28k unique domains before it stalls.how do u generate millions of url?

 

download

Supreme Member

May 4, 2010

1,272

715

• May 24, 2011

• #2

First off you will need more proxies, I recommend using public proxies.

Also, go to the select engines & proxies section, and change the number in the results field. Increasing it will give more results per keyword.

 

X

xinoanet

Regular Member

Aug 8, 2009

216

30

• May 24, 2011

• #3

usually people have been using private proxies for scraping to prevent their private ones from being banned from google