1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Block Certin Pages/Posts From Search Engines: Wordpress

Discussion in 'White Hat SEO' started by Abercrombie, Dec 28, 2008.

Tags:
  1. Abercrombie

    Abercrombie BANNED BANNED

    Joined:
    Mar 8, 2007
    Messages:
    394
    Likes Received:
    345
    The title explains it all. I would like to block a particular post or page of my Wordpress blog from search engines. I am wondering if there is a plugin out there that I can utilize to accomplish this, or perhaps a code that I insert into the post.
    The thing is that I want to do a post about a company from wikipedia as it will be great info for my users, but I don't want to get smacked down by Google for it.
    On another note, how badly would I get smacked if I simply posted it? I have a lot of original content.
     
  2. trophaeum

    trophaeum Senior Member

    Joined:
    Dec 21, 2007
    Messages:
    1,189
    Likes Received:
    706
    robots.txt is your simplest method
     
  3. Abercrombie

    Abercrombie BANNED BANNED

    Joined:
    Mar 8, 2007
    Messages:
    394
    Likes Received:
    345
    I have a plugin that generates a new robots on command, so I run it like once per week. I could still take the page out of the robots.txt manually. So my robots.txt reads:

    # BEGIN XML-SITEMAP-PLUGIN
    Sitemap: http://site.com/sitemap.xml.gz
    # END XML-SITEMAP-PLUGIN

    Anyway I found a way exclude pages and posts in that. Sorry for being a total newb sometimes!

    Should I not use a sitemap. I did not realize that this was all that there is in the robots.txt until now. I heard that a robots document is very important. Do you think that this is a bad thing or fine because it is just redirecting the spider?

    Also, sometimes I here it is important to exclude categories. Is this true? What about the tags?.......

    Thanks for everything. It's nice to know that there are people here that know their sh't!:D

    It's also good to know that I am not the only newb here.:p
     
  4. dmed123

    dmed123 Junior Member

    Joined:
    Aug 16, 2008
    Messages:
    171
    Likes Received:
    125
    No you want to use a sitemap so you do get indexed on the pages you want. Just block out the pages you don't want in your robots.txt and you will be fine.
     
  5. shrkscn

    shrkscn Junior Member

    Joined:
    Feb 20, 2008
    Messages:
    134
    Likes Received:
    156
    You can also use robots meta wordpress plugin to selectively block the pages / posts from indexing.. Have attached the plugin. gives full control for pagess / posts
     

    Attached Files:

  6. Abercrombie

    Abercrombie BANNED BANNED

    Joined:
    Mar 8, 2007
    Messages:
    394
    Likes Received:
    345
    Thank-you for this!