Wordpress SEO - Robots
- Thread starter newnerd
- Start date
-
- Tags
- robot.txt wordpress seo
seocrab
Elite Member
- May 2, 2013
- 1,579
- 1,991
As a security measure, your Wordpress robots.txt should read as follows:
This will block access to footer.php.
Code:
#
User-agent: *
Disallow: /cgi-bin
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-content/plugins/
Disallow: /wp-content/cache/
Disallow: /wp-content/themes/
Disallow: */trackback/
Disallow: */feed/
Disallow: /*/feed/rss/$
Disallow: /category/*This will block access to footer.php.
scorpion king
Supreme Member
- May 2, 2010
- 1,240
- 2,454
I can see it will block wordpress pages to be crawled. Can you please tell me which link here will block footer only.
I don't think you can block only footer, because it part of page. You can block an entire page but not a part of it. But i am not 100% sure about it, ask suggestions from others as well.
Endire
Elite Member
- Mar 27, 2012
- 1,756
- 1,075
Newnerd,
You can only blog entire directories or pages in directories from being crawled but you cannot block portions of pages from being crawled using robots.txt.
There are some tips on this thread for blocking portions of a page however they are borderline cloaking which I do not recommend. It could backfire on you,
http://stackoverflow.com/questions/2004614/how-to-exclude-part-of-a-web-page-from-googles-indexing
Best,
Shawn
You can only blog entire directories or pages in directories from being crawled but you cannot block portions of pages from being crawled using robots.txt.
There are some tips on this thread for blocking portions of a page however they are borderline cloaking which I do not recommend. It could backfire on you,
http://stackoverflow.com/questions/2004614/how-to-exclude-part-of-a-web-page-from-googles-indexing
Best,
Shawn
Hubba
Elite Member
- Feb 6, 2010
- 1,994
- 1,084
If you don't want G to crawl the visible footer on you page you should put your footer content in a directory that you prohibit with robots.txt. Then you use an iframe to show the content in the footer. Make sure you also use the<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW"> on the page with the footer content in the prohibited directory.
In reality G bot will still "see" this content, but it won't be indexed.
In reality G bot will still "see" this content, but it won't be indexed.
Does this robot code makes any sense:
and also using
in the home page above the <div class="Footer"> section.
[ The path of my footer file is:
/public_html/wp-content/themes/folder/footer.php
There is a link in the footer which is encrypted in functions.php
and the footer is being called by every page with the code
<?php get_footer(); ?>]
Code:
User-agent: *
Disallow: /*footer.php
Code:
<META NAME="ROBOTS" CONTENT="NOINDEX, NOFOLLOW">[ The path of my footer file is:
/public_html/wp-content/themes/folder/footer.php
There is a link in the footer which is encrypted in functions.php
and the footer is being called by every page with the code
<?php get_footer(); ?>]
Last edited:
