1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What to scrape to find good expired domains?

Discussion in 'Black Hat SEO' started by nobody00, May 8, 2015.

  1. nobody00

    nobody00 Regular Member

    Joined:
    May 21, 2011
    Messages:
    364
    Likes Received:
    53
    I tried scraping:
    1. directories = will result in domains with weak backlinks from directories
    2. google results by searching "niche" + blogroll/links/partners and time range 2000 - 2009 = will result in domains with backlinks from pages with more than 100 OBL, even if you scrape only high pr links, the link juice that this pages with high obl will pass will be very low because of too many obl obviously.

    What the heck do you guys scrape to find good expired domains because i'm out of ideas.
     
    Last edited: May 8, 2015
  2. cipango

    cipango Junior Member

    Joined:
    Mar 16, 2011
    Messages:
    180
    Likes Received:
    40
    try deeper keywords not just niche. Yes, the high OBL pages are always there, but with a lot of deep niche keywords, you will also find good domains.

    Another way to find good clean sites is to filter the list of results by PR. Keep only the PR 5+ or 4+ results, or even just the 6+ ones, and put those in Xenu. Those are usually high-quality pages. You need some 50-60+ private proxies for that to work without interruption, or be very patient with the public proxies.

    Yet another way is to try your keywords against .edu and .gov sites. Use footprints like "keyword site:.edu" or "keyword site:.gov" and you will only get results from those types of sites. I wouldn't worry about date intervals much. Or just mention a year in your search, 2008, or 2009, or 2010 etc. And you can always experiment with adding blogroll/links/partners and such, to see what yields more results.

    Once you have your list of domains from Xenu, take them, put them in Scrapebox, Remove duplicate domains, then Trim to root, then put those into a domain availability checker like the Dynadot bulk checker (I found that to be the best, allows 1000 domains at a time). So you end up with a list of only those domains that are available to reg.

    The way to judge the domains: PR is deprecated. It has not been updated in almost 2 years now, and so you're going to miss all the newer domains that have gotten value.

    The way I do it is so: with the list of domains from Dynadot, I dump it in Netpeak (it's free) and get the Moz DA for all of them. I export the list in Excel and filter only DA>20 domains. These days I don't look much at domains with DA<25, only higher, because it's a bunch of them in the DA20-25 range. When you search from academic sites however and you get fewer results, you may want to keep those as well, since if they got good academic links, they have good trust in Google's eyes. It's good to have domains with academic links in your PBN. But generally, if you're putting a good amount of effort into this method and keep at it, you will soon start to find DA30+ domains, and only aim for those.

    So, once you have your list of domains filtered by DA *(see also note below), start checking each in the Moz Site Explorer, or Ahrefs or Majestic if you have them. The Moz Site Explorer would do the job if you don't have the others. See where the links are coming from, whether follow/nofollow, if they're in the article body or comments, etc. If the links are citations, i.e. in the article body on legit sites (not PBN), that's a sign the domains are good. If you see very little comment spam to none, then that's a good-looking domain. Don't forget however to check its history in archive.org, since there may be surprises, like at some point it was made a chinese site, or a PBN site.

    * you may not want to also sort your list by DA and get all your domains mixed - better keep them unsorted, to keep the ones coming from the same source together. This way, if they come from a bad source, they'll be grouped together and you can skip them just by looking at them, till you arrive at a good group.

    And for me, that's about it. The rule is pretty simple: if a domain is DA20+ or better, and has clean link profile and clean history, I register it. I then put wordpress on it, leaving the default installation, and see how fast it is indexed. If it's indexed in a matter of days, then that's another indication it's a good domain. I only had a couple domains not getting indexed at all, out of some 40 that I put in my PBN. Actually one was just indexed after about a year, and I'm wondering whether to use it now lol.

    I very seldom check for Majestic TF/CF, if ever. If you have a paid account, go ahead and look at it. But I found that if the DA is high and the link profile is clean, usually the TF/CF are good too. When you check TF/CF, you'll notice that the results differ for www.domain.com and just domain.com. It could also be another subdomain than www that has the good metrics, so don't discard a domain just because the root domain has low TF/CF. Just something to keep in mind.

    Do these domains work? Yes they do, I was pretty surprised to find that out myself. Give them time, especially if you're registering them anew, and they'll show results. It won't be immediate results, but they'll be pretty good ones a few months down the road. I believe there's a time period that Google puts them on hold after registering, like around 3 months to 6 months, but after that time, they'll show strength. All you have to do is keep posting content on your money site, and slowly build links from the PBN. Keep adding content, that's very important. Don't just add a couple of articles and start building PBN links, and then do nothing till you see results. Keep adding content even if you don't see results. You'll be much more rewarded if you do that.
     
    • Thanks Thanks x 5
  3. 7yearitch

    7yearitch Regular Member

    Joined:
    Dec 5, 2013
    Messages:
    489
    Likes Received:
    142
    Occupation:
    dog food tester
    Location:
    growing on trees
    The above is a great suggestion. I always target governenment institutions because their sites are seldom well-maintained.

    Another thing I would do is to download the links from the gov websites using ahrefs or whatever and scrape those links for domains. I've found that the domains I get using this method have really high trust flow. Hope this helps
     
    • Thanks Thanks x 1
  4. qrazy

    qrazy Senior Member

    Joined:
    Mar 19, 2012
    Messages:
    1,115
    Likes Received:
    1,723
    Location:
    Banana Republic
    Scrape inner pages of huge authority/editorial sites like Techcrunch, Entrepreneur, CNN, Examiner etc. You can find a huge list here.
     
    • Thanks Thanks x 1
  5. riesty

    riesty Regular Member

    Joined:
    Jul 13, 2014
    Messages:
    414
    Likes Received:
    87
    use tool brother :)
    example: if you scrape Forbes.com then the tools will show all deadlink and filter all deadlink to availability domain
    so nothing waste your time :)
     
    Last edited: May 8, 2015
  6. Knocks

    Knocks Newbie

    Joined:
    May 14, 2012
    Messages:
    16
    Likes Received:
    2
    In my experience a quality expired domain will rarely be available for hand registration. It will likely be discovered by other drop catchers, and you'll have to battle it out in an auction, at which point you'll end up paying real money for it (which is fine, by the way, if your budget allows it).
     
  7. cipango

    cipango Junior Member

    Joined:
    Mar 16, 2011
    Messages:
    180
    Likes Received:
    40
    Not true. You can still find lots of good domains. You have to be persistent though, as it's a bunch of work