1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to scrape expired Domains after the shutdown of PR?

Discussion in 'Black Hat SEO' started by Gravity88m, Jul 12, 2016.

  1. Gravity88m

    Gravity88m Newbie

    Joined:
    Nov 16, 2015
    Messages:
    24
    Likes Received:
    6
    Hey guys,

    since a few days im gonna search free to register expired Domains with Scrapebox. I've read many Tutorials for that, but all of them filter the harvested urls by PR.

    Since the shutdown of PR (april '16) all bulk checker returns the PR "0". So how do you recommend to filter out the junk urls from huge url-lists?

    If i scrape my source footprints im getting about 40000 urls. After cleaning them up ~5000 urls remains. In the next step the most tutorials filter them by PR and gets then a small url list for the scraping of external links.

    And here is my problem. 5000 urls are to many for bulk check DA/PA or TF/CF. And exporting external links from them results in even bigger lists.

    I got the following tools:
    -Paid Majestic Account (No API)
    -Moz Account (4x Free API)
    -Market Samurai (Doesnt work well with such huge lists)
    -Scrapebox and Expired Domain Plugin (Take a really long time for checking DA/PA -> ~4-8 hours for 1200 urls)
    -Netpeak Checker (Trial expired and the results were very poor)
    -Big Proxy list (fast and reliable)

    Im ready to pay for new tools, but then they should make a good job (cannot recommend Scrapebox Expired Domain Plugin)

    Okay now its your part. Thank you very much!
    Best regards
    Marc
     
  2. Floopa75

    Floopa75 Jr. VIP Jr. VIP

    Joined:
    Feb 6, 2014
    Messages:
    891
    Likes Received:
    760
    Gender:
    Male
    Occupation:
    Summit Rank Link Building
    Location:
    Canada
    Home Page:
    Personally I'd take those 5000 into Majestic, check them with the bulk checker tool, download the .csv and then cut away any with under 5 TF and under 3 referring domains. That alone will cut out a lot of useless domains and leave you with not many to look over. From my experience doing this will cut away a solid 90% of the useless domains and leave with the ones worth looking through. Out of those 5000, maybe 500 will pass the 5 TF, higher than 3 RD standard.

    I wouldn't rely on TF for anything other than cutting away useless domains, though, it is not reliable to decide whether or not a domain is good. Only really good at cutting out the crappy domains. A domain that Majestic says has 0 TF and 0 RD isn't worth your time.

    5000 domains ---> Majestic bulk checker ---> download .csv ---> sort by TF ---> delete anything with under 5 TF ---> sort by referring domains ---> anything under 3, delete ---> check remaining

    Edit - I don't think you can do 5000 at a time in Majestic so you might have to do it in separate lists
     
  3. Gravity88m

    Gravity88m Newbie

    Joined:
    Nov 16, 2015
    Messages:
    24
    Likes Received:
    6
    Hey Floopa, thanks for your reply!
    I have already thought about this method, but Majestic has a maximum limit of Bulk-Checks in their plans, so i want to save as much as possible. But ive just sent an email to Majestic. Im not sure if the silver-quarterly includes 5.000.000 checks per month or per period (3 months).

    If its per month (15.000.000 per period), then your method could be a good workaround.
     
  4. wisdomkid

    wisdomkid Jr. VIP Jr. VIP

    Joined:
    Jun 20, 2011
    Messages:
    2,723
    Likes Received:
    794
    I was about recommending this same Method. using TF, you can scrap out lots of useless domains for BHW.

    Since Pagerank is gone, the closest thing Webmasters have to it, is the Trust Flow algorithm. Goodluck
     
  5. Gravity88m

    Gravity88m Newbie

    Joined:
    Nov 16, 2015
    Messages:
    24
    Likes Received:
    6
    Hmm okay... ive got the answer from majestic. In the silver-plan you got only 25k of link-checks per month.
    That makes it more difficult to me. Btw... did you know that bulk checks via automation software is not allowed even with a paid account and maximum limit? The service said to me that the account will get banned, if i do so.

    Here is the answer from Majestic:
    "OK, with a Silver subscription you can copy and paste up to 25,000URL/month or upload a file up to 50,000URLs in one month. It's calculated based on URL, not the amount of times you do it.

    Within the Site Explorer it's hundreds of websites that you can look through each month, as long as you do it manually. If you would try to do it via automated system, the subscription would get blocked.
    The amount of reports have been presented at our Plans & Pricing page"
     
  6. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    3,875
    Likes Received:
    2,058
    Gender:
    Male
    Home Page:
    Are you using the latest version of the expired finder? Its had multiple updates in the past week ish.