1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

how do u scrape massive list of url using scrapebox?

Discussion in 'Black Hat SEO Tools' started by lmaestro, May 24, 2011.

  1. lmaestro

    lmaestro Power Member

    Joined:
    Jan 28, 2011
    Messages:
    666
    Likes Received:
    227
    how many keywods and proxies do u use.im using 10 private proxies and 2k keywords and can only harvest 28k unique domains before it stalls.how do u generate millions of url?
     
  2. download

    download Jr. VIP Jr. VIP Premium Member

    Joined:
    May 4, 2010
    Messages:
    1,271
    Likes Received:
    712
    Location:
    USA
    First off you will need more proxies, I recommend using public proxies.

    Also, go to the select engines & proxies section, and change the number in the results field. Increasing it will give more results per keyword.
     
  3. xinoanet

    xinoanet Regular Member

    Joined:
    Aug 8, 2009
    Messages:
    216
    Likes Received:
    30
    Location:
    Kitchener, Ontario
    usually people have been using private proxies for scraping to prevent their private ones from being banned from google