1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Anyway to find All expired domains until now

Discussion in 'Black Hat SEO' started by yourdady, Nov 9, 2014.

  1. yourdady

    yourdady Regular Member

    Joined:
    Apr 4, 2014
    Messages:
    417
    Likes Received:
    65
    Gender:
    Male
    Location:
    instarobot.com
    hi everyone,

    I dont know its possible or not but my question is there anyway to find all expired domains like domains which were registered in 2001 , 2002 or way back I think in expireddomains is just showing recently expired domains not all domains which is expired until now.


    Thanks in advance
     
  2. souleclipse

    souleclipse Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 28, 2011
    Messages:
    1,054
    Likes Received:
    210
    Gender:
    Male
    Home Page:
    You need to learn how to scrape, is not something so easily to do, require huge amount of resources.
    Expired domains lose their age anyway...
     
    • Thanks Thanks x 1
  3. yourdady

    yourdady Regular Member

    Joined:
    Apr 4, 2014
    Messages:
    417
    Likes Received:
    65
    Gender:
    Male
    Location:
    instarobot.com

    So their no software out there which can do this job for me?
     
  4. FBGuru

    FBGuru Senior Member

    Joined:
    Sep 22, 2013
    Messages:
    928
    Likes Received:
    1,171
    Location:
    Personality Type : ESTP
    You can't find "ALL the expired domains" unless you're the son of ICANN's top-head, but there are certain ways to automate the domain hunting and 2 specific softwares can do this job.

    Xenu's Link Sleuth, a freeware and the paid one is the Screaming Frog SEO Spider. Both these softwares basically crawl any given website/list of urls and reports broken links both internal & external. Filter the external links and check the Whois, domain metrics and pick your domain.
     
  5. seoofcutss

    seoofcutss Newbie

    Joined:
    Nov 9, 2014
    Messages:
    8
    Likes Received:
    0
    You will have to scrape for these, but i dont see a point to going for old expired domains, unless they have quality backlinks.
     
  6. regicider

    regicider Junior Member

    Joined:
    Apr 2, 2012
    Messages:
    107
    Likes Received:
    54
    There are also two other paid solutions that float around this forum, specifically built for expired domain crawling. Expired Domain Miner and DomRipper (disclaimer: I'm the founder of DomRipper)
     
    • Thanks Thanks x 1
  7. FBGuru

    FBGuru Senior Member

    Joined:
    Sep 22, 2013
    Messages:
    928
    Likes Received:
    1,171
    Location:
    Personality Type : ESTP
    I've not heard about your software and yeah, Expired Domain Miner developer offered me to test out her software a few months back and I noticed it's using powerful Apache Nutch crawler for crawling the seed lists. How many threads can your software support and How's its memory footprint?
     
  8. tony_d

    tony_d Elite Member

    Joined:
    Jun 22, 2013
    Messages:
    2,581
    Likes Received:
    3,164
    Location:
    1600 Amphitheatre Parkway, Mountain View CA
    As an original beta tester of regiciders Dom Ripper, I'm going to go ahead and say it is fantastic, and would recommend it to anyone who wants a lightweight (not resource intensive) crawler that finds expired domains.

    Sean (regicider) put a lot of work into managing the memory footprint - I think there were about 6 different beta releases that we worked with, specifically related to managing the issue of RAM usage.
    For a few hundred dollars a month, it will sit on a VPS and churn out expired domains by the hundreds.

    The only other solution to find "all" expired domains is to literally crawl the entire internet yourself... we built a spider that crawls and finds expired domains, and have now crawled xx,xxx,xxx unique domains. It's certainly not a task for the faint hearted - and you'll need a serious monetization method if you hope to recover the cost of crawling the interwebs!
     
    • Thanks Thanks x 1
  9. Wyzard

    Wyzard Junior Member

    Joined:
    Jul 1, 2014
    Messages:
    121
    Likes Received:
    9
    I have an issue with expireddomain and I'll definitely look into this DomRipper as it sounds lite when it comes
    to resources. Thanks for this information tony_d. Appreciated.