1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Wordpress SEO - Robots

Discussion in 'White Hat SEO' started by newnerd, Aug 31, 2013.

  1. newnerd

    newnerd Newbie

    Joined:
    Jan 19, 2013
    Messages:
    45
    Likes Received:
    7
    I have a Word press Website.


    I want search engine robots not to follow the Footer part of the site.


    Where and what to write in the robot.txt file? Do I need to write anything on the footer.php file? - Please Help
     
    Last edited: Aug 31, 2013
  2. seocrab

    seocrab Senior Member

    Joined:
    May 2, 2013
    Messages:
    969
    Likes Received:
    825
    Occupation:
    seo freelancer
    Location:
    UK
    As a security measure, your Wordpress robots.txt should read as follows:

    Code:
    #
    User-agent: *
    Disallow: /cgi-bin
    Disallow: /wp-admin
    Disallow: /wp-includes
    Disallow: /wp-content/plugins/
    Disallow: /wp-content/cache/
    Disallow: /wp-content/themes/
    Disallow: */trackback/
    Disallow: */feed/
    Disallow: /*/feed/rss/$
    Disallow: /category/*
    This will block access to footer.php.
     
  3. scorpion king

    scorpion king Senior Member

    Joined:
    May 2, 2010
    Messages:
    1,157
    Likes Received:
    2,393
    Occupation:
    Entrepreneur
    Location:
    irc.blackhatworld.com
    I can see it will block wordpress pages to be crawled. Can you please tell me which link here will block footer only.

    I don't think you can block only footer, because it part of page. You can block an entire page but not a part of it. But i am not 100% sure about it, ask suggestions from others as well.
     
  4. Endire

    Endire Elite Member Premium Member

    Joined:
    Mar 27, 2012
    Messages:
    1,756
    Likes Received:
    1,061
    Gender:
    Male
  5. Hubba

    Hubba Regular Member

    Joined:
    Feb 6, 2010
    Messages:
    379
    Likes Received:
    94
    If you don't want G to crawl the visible footer on you page you should put your footer content in a directory that you prohibit with robots.txt. Then you use an iframe to show the content in the footer. Make sure you also use the<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> on the page with the footer content in the prohibited directory.

    In reality G bot will still "see" this content, but it won't be indexed.
     
  6. newnerd

    newnerd Newbie

    Joined:
    Jan 19, 2013
    Messages:
    45
    Likes Received:
    7
    Does this robot code makes any sense:

    Code:
    User-agent: *
    Disallow: /*footer.php
    and also using

    Code:
    <META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> 
    in the home page above the <div class="Footer"> section.

    [ The path of my footer file is:
    /public_html/wp-content/themes/folder/footer.php

    There is a link in the footer which is encrypted in functions.php
    and the footer is being called by every page with the code
    <?php get_footer(); ?>]
     
    Last edited: Sep 7, 2013
  7. geo21

    geo21 Newbie

    Joined:
    Sep 2, 2013
    Messages:
    7
    Likes Received:
    0
    ..or you can try the Yoast wordpress Seo plugin :)