1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

A description for this result is not available because of this site's robots.txt

Discussion in 'White Hat SEO' started by NX_NULL, Nov 2, 2016.

  1. NX_NULL

    NX_NULL Regular Member Premium Member

    Joined:
    Dec 31, 2008
    Messages:
    324
    Likes Received:
    428
    I searched my website on google and I got this message under my website name
    "A description for this result is not available because of this site's robots.txt"

    I do Not have any robots.txt on my root domain, Any one has any idea why google is showing this message?
     
  2. Rich77ard

    Rich77ard Registered Member Premium Member

    Joined:
    Mar 20, 2010
    Messages:
    65
    Likes Received:
    42
    Gender:
    Male
    Occupation:
    Web Design - SEO - Entrepreneur
    Location:
    Australia
    Have you double-checked your WordPress reading settings. If you're logged into WordPress already just navigate to this URL (change it to your domain name): http://your-site.com/wp-admin/options-reading.php - just make sure that the 'Search Engine Visibility' box is not checked as you probably have a virtual robots.txt file active.

    Even if you don't have that active, Google may not have crawled it again since you switched that off which is why they're showing that message. If that's the case you just have to wait for them to re-crawl it again or resubmit the URL in Google Webmaster tools to force them to re-crawl it.
     
  3. Silverandblack

    Silverandblack Junior Member

    Joined:
    Mar 26, 2013
    Messages:
    103
    Likes Received:
    20
    If you don't have one at all, make one and set your access rules accordingly. You might also want to search in your hostings file manager to make sure there isn't one lingering around that isn't set up right.
     
  4. For some reason when you do a fresh install of Wordpress it automatically has the read setting for search engine visibility off. Don't know why.
     
  5. NX_NULL

    NX_NULL Regular Member Premium Member

    Joined:
    Dec 31, 2008
    Messages:
    324
    Likes Received:
    428
    My website isnt Wordpress, Its just simple HTML pages