1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.
  2. Hey Guest Last month we upgraded BlackHatWorld.com to a new platform - . If you notice anything that requires attention please start a new thread here.
    Dismiss Notice

Possible to edit the robots.txt file for a Tumblr blog?

Discussion in 'Social Networking Sites' started by kaylanewett, Jul 7, 2013.

  1. kaylanewett

    kaylanewett Jr. VIP Jr. VIP Premium Member

    Joined:
    Jun 8, 2013
    Messages:
    611
    Likes Received:
    549
    Location:
    NYC
    Today on my Adsense scorecard my Revenue Optimization score dropped from 5 to 2 because one of the crawlers was denied. However, this website of mine is based on Tumblr and I have no idea how to get to the file. I checked on Google first and nothing helped. Any ideas?
     
  2. G-S-T

    G-S-T Executive VIP

    Joined:
    Jan 20, 2011
    Messages:
    1,828
    Likes Received:
    8,775
    Occupation:
    Full time IM
    Location:
    Heavy in the game
    There are a few limited things you can do using meta tags

    Code:
    <META NAME="ROBOTS" CONTENT="NOINDEX, FOLLOW">
    <META NAME="ROBOTS" CONTENT="INDEX, NOFOLLOW">
    <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">