1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

can't seem to harvest more than 850,000 domain URLs in ScrapeBox

Discussion in 'Black Hat SEO' started by SuzieQBlackHat, Apr 6, 2017.

  1. SuzieQBlackHat

    SuzieQBlackHat BANNED BANNED

    Joined:
    Feb 8, 2017
    Messages:
    120
    Likes Received:
    17
    Gender:
    Male
    I've run around 100 URL harvests with tens of thousands of different keywords and I've merged all my results into one file, and clicked Remove Duplicate Domains. For some reason I can't really seem to get more than 850,000 unique domain URLs. Is that about the limit on average, or am I doing something wrong?
     
  2. Nargil

    Nargil Jr. VIP Jr. VIP

    Joined:
    May 10, 2012
    Messages:
    3,984
    Likes Received:
    2,560
    Location:
    Europe
    Home Page:
    Those are all possible targets that you can hope to find with your keywords.
     
  3. SuzieQBlackHat

    SuzieQBlackHat BANNED BANNED

    Joined:
    Feb 8, 2017
    Messages:
    120
    Likes Received:
    17
    Gender:
    Male
    I am using a massive list of keywords that are very varied, and yet still seem to only be able to find around 850,000 max. Occasionally getting a new 10,000 or 20,000 unique URLs through each new scrape. So it's a pretty slow process and there is obviously a lot of repetition going on here