1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

A description for this result is not available because of this site's robots.txt – learn m

Discussion in 'Black Hat SEO' started by molibwe, Sep 17, 2014.

  1. molibwe

    molibwe Regular Member

    Joined:
    Dec 18, 2012
    Messages:
    422
    Likes Received:
    48
    Home Page:
    Hi everybody,

    My blogger blog shows up in google with this descrition: "A description for this result is not available because of this site's robots.txt ? learn more."

    In google webmasters tools I found my robot txt. which looks fine.

    Code:
    User-agent: Mediapartners-Google
    Disallow: 
    
    
    User-agent: *
    Disallow: /search
    Allow: /
    
    
    Sitemap: http://{{{{mybloggersite}}}.blogspot.com/atom.xml?redirect=false


    Can anyone please tell me what's the problem with it. If you have ever experienced this error, please help.
    When I googled this error I found that my robot file is fine though.
    Maybe I'm not the only one who wants to know this.


    Thanks in advance.
     
  2. archon10

    archon10 BANNED BANNED

    Joined:
    Oct 10, 2011
    Messages:
    1,181
    Likes Received:
    1,660
    Why doesn't anyone ever mention that they changed the robots.txt recently?

    You need a recrawl. Wait.
     
    • Thanks Thanks x 1
  3. molibwe

    molibwe Regular Member

    Joined:
    Dec 18, 2012
    Messages:
    422
    Likes Received:
    48
    Home Page:
    Thanks. I just submitted it again. Let's see if it will change.
     
  4. SEO Power

    SEO Power Elite Member

    Joined:
    Jul 14, 2014
    Messages:
    2,637
    Likes Received:
    680
    Occupation:
    Self employed
    Location:
    Houston, TX
    Your site was crawled when your robots.txt file was blocking Google. Now that it isn't blocking Google, you have to wait for a recrawl before your description will start appearing in the results.
     
    • Thanks Thanks x 1
  5. molibwe

    molibwe Regular Member

    Joined:
    Dec 18, 2012
    Messages:
    422
    Likes Received:
    48
    Home Page:
    Thanks for the good explanation.:)
     
  6. rankwatch12

    rankwatch12 Regular Member

    Joined:
    Jun 19, 2014
    Messages:
    235
    Likes Received:
    13
    Home Page:
    Just a crawl issue. I would suggest you to wait for sometime.