1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Narrow down a list of 500,000 expired domains by backlinks

Discussion in 'Black Hat SEO' started by OzGold, Aug 24, 2011.

  1. OzGold

    OzGold Registered Member

    Joined:
    May 30, 2011
    Messages:
    57
    Likes Received:
    11
    I have a list of 500K domains that I want to examine backlinks to work out how many are worth registering. What's the most efficient way to do this using proxies or whatever without my scripts getting continually banned?

    I just need a step to crudely narrow it down to 20,000 or so so I can then use my other tools to really drill down into the data.

    Thanks for any help
     
  2. SuperLinks

    SuperLinks Elite Member

    Joined:
    Jul 14, 2008
    Messages:
    2,903
    Likes Received:
    847
    Location:
    New York
    Scrapebox and as many public proxies as you can get your hands on.

    It may take running it a few times to get links for all of the domains but you should be able to check on roughly 75% of the domains.
     
    • Thanks Thanks x 2
  3. Kickflip

    Kickflip BANNED BANNED

    Joined:
    Jan 29, 2010
    Messages:
    2,038
    Likes Received:
    2,465
    Yes that is how I do it. Also I run it on Alexa/Fake PR Checker (Or manually check to see if fake PR).
     
    • Thanks Thanks x 1
  4. registercompass

    registercompass Newbie

    Joined:
    Aug 13, 2011
    Messages:
    1
    Likes Received:
    0
    Try RegisterCompass - huge database on expired domains all updated with SEO values.

    You can also add your own domains there so you dont have to deal with google bans at all ;)
     
  5. OzGold

    OzGold Registered Member

    Joined:
    May 30, 2011
    Messages:
    57
    Likes Received:
    11
    Thanks guys - actually I just subscribed to registercompass and I think it's fantastic. Really happy with it but it only does gTLDs as far as I can see

    Trouble is you can only add 2,000 of your own domains. Hence my need to narrow the domains down to 20,000 or so (was planning to use RC following that, and then finally do some manual analysis).

    If there's a way I can add more than 2,000 (even if I have to pay) or use your proxies to narrow down by Yahoo links, please let me know!