1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Tumblr Not Found List

Discussion in 'Black Hat SEO' started by MariosElGreco, Jan 26, 2016.

  1. MariosElGreco

    MariosElGreco Regular Member

    Joined:
    May 31, 2014
    Messages:
    261
    Likes Received:
    8
    Gender:
    Male
    Occupation:
    http://eas-seo.com
    Location:
    Greece
    Home Page:
    Tumblr 404 error list. I crawl 12millions of url's.
    For obvious reasons i'd rather not say the name of the software "even if figure out the name, you'll need at least 256gb ram to crawl websites as tumblr/fb/twitter etc" so no need either way.
    The % is actually the percent of every link that software found at this moment, not of entire website. The entire website is estimate 18-20 trillions of uri's. even with my complex of servers its difficult to crawl everything, but hopefully not possible.
    Above at 60% is 404 errors.
    I just wanted to share with you my moment :p
    better.jpg