1. This website uses cookies to improve service and provide a tailored user experience. By using this site, you agree to this use. See our Cookie Policy.
    Dismiss Notice

How to mass check (XXX.XXX) http status? (looking for expired tumblr)

Discussion in 'Black Hat SEO Tools' started by BhutJolokia, Mar 14, 2019.

  1. BhutJolokia

    BhutJolokia Jr. VIP Jr. VIP

    Joined:
    Feb 23, 2015
    Messages:
    562
    Likes Received:
    232
    Hey!

    I was previously messing around with scrapebox and came to the conclusion that the alive checker addon was returning a lot of wrong positives (if set to 404 as positive) and was kinda slow. Now I'm pretty sure this is mainly because I don't know how to properly handle the software yet, this is why I'm looking for advice.

    How do you mass check your scraped tumblrs for available ones? Could someone suggest me a software? Or some really good video guide you know works great?

    Thanks in advance!
     
  2. BhutJolokia

    BhutJolokia Jr. VIP Jr. VIP

    Joined:
    Feb 23, 2015
    Messages:
    562
    Likes Received:
    232
    Still looking for a simple solution ;)
     
  3. SiddharthW

    SiddharthW Jr. VIP Jr. VIP

    Joined:
    Jul 29, 2017
    Messages:
    710
    Likes Received:
    328
    Gender:
    Male
    Which useragent are you using with scarpebox ?
     
    • Thanks Thanks x 1
  4. test123test

    test123test Regular Member

    Joined:
    Jun 25, 2009
    Messages:
    220
    Likes Received:
    74
    It doesn't work with tumblr I tried it along time ago. Works good with normal websites though.
     
    • Thanks Thanks x 1
  5. BhutJolokia

    BhutJolokia Jr. VIP Jr. VIP

    Joined:
    Feb 23, 2015
    Messages:
    562
    Likes Received:
    232
    Oof, wasn't aware that I need one (didn't use any useragent). The video guides I watched either didn't use one or were so old that it wasn't an option back then :oops:. Do I have to pick a specific one to make it work for tumblrs? Cheers!

    Did you find a way around it? Thanks!
     
  6. test123test

    test123test Regular Member

    Joined:
    Jun 25, 2009
    Messages:
    220
    Likes Received:
    74
    I bought a username checker from guy on a hacker forum and it worked ok just couldn't support a big list. I am sure if its worth your time you could have something coded very cheap.
     
    • Thanks Thanks x 1
  7. ThatSEO

    ThatSEO Jr. VIP Jr. VIP

    Joined:
    Jan 22, 2016
    Messages:
    1,280
    Likes Received:
    986
    Gender:
    Male
    Occupation:
    Self employed marketing stuff
    Location:
    Sometimes UK
    Either a good formula in excel or use seo tools for excel - not sure if limited these days but worth paying for

    Free - Xenu if it’s still going and available to download

    Screaming frog is the cleanest
     
    • Thanks Thanks x 1
  8. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    4,702
    Likes Received:
    2,518
    Gender:
    Male
    Home Page:
    Well your "doing it wrong" as they say. The alive checker isn't meant to be used to find expired web 2.0s. You need more then just a simple alive check, you need to qualify other parameters. Thats the entire reason the Vanity name checker addon was built. The vanity addon is specifically designed with the functionality needed to check expired web 2.0s.

    Bearing in mind tumblr is highly sought after and the vanity addon only gives you a general indication, it does not attempt to register. So if a domain is banned from reregistration, the vanity addon can't know that. But its going to get you a lot closer then the alive checker.




    Same as above
     
    • Thanks Thanks x 1
  9. Jay Yadav

    Jay Yadav Jr. VIP Jr. VIP

    Joined:
    Mar 14, 2013
    Messages:
    2,462
    Likes Received:
    846
    Gender:
    Male
    Location:
    websettlor.com
    Home Page:
    SB Alive Checker !
     
  10. BhutJolokia

    BhutJolokia Jr. VIP Jr. VIP

    Joined:
    Feb 23, 2015
    Messages:
    562
    Likes Received:
    232
    Well.... That's what I get for being impatient. I've watched this video before but stopped because I thought it's only to check for available names and not expired ones :oops:

    Thanks a lot! It works like a charm ;)

    I just have one problem: In the current SB version the lines "Status" and "Result" have merged into one and I have many cases where it doesn't switch from "Completed" to either "Taken" or "Available". Do you know this problem and how to fix it? Could it be because of some bad proxies inbetween the ones I've scraped?

    That's what I was already trying
     
  11. loopline

    loopline Jr. VIP Jr. VIP

    Joined:
    Jan 25, 2009
    Messages:
    4,702
    Likes Received:
    2,518
    Gender:
    Male
    Home Page:
    Yes, if it says completed but doesn't give you a "estimate" of if its taken or available it means either the connection was hijacked and the content scrapebox got back wasn't correct or the page never loaded. So bad proxies, security software, etc...
     
    • Thanks Thanks x 1