1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

robots.txt wordpress seo

Discussion in 'White Hat SEO' started by GreenDolla, Apr 25, 2010.

  1. GreenDolla

    GreenDolla Regular Member

    Joined:
    Nov 13, 2009
    Messages:
    260
    Likes Received:
    74
    Occupation:
    Mobile
    Location:
    Atlanta
    i need a little help im using this as my permalinks /%category%/%postname%/ and plugin top level categories it takes out the category before the category name..now im trying to perfect all seo factors so i would like to dis allow all categories from being indexed so i don't have any dup content..but i don't know how to do it if i disallow the category would it not let my pages be indexed..can some one show me an example on how to do it..lets say my category is cars how would it look thanks
     
  2. socomm

    socomm Newbie

    Joined:
    Mar 30, 2010
    Messages:
    2
    Likes Received:
    0
    If you can edit the html of /cars/ for example add the following between the head tags:

    Code:
    [COLOR=#0000A0]<[/COLOR][COLOR=#B22222]meta[/COLOR] [COLOR=#FF0000]name[/COLOR][COLOR=#0000A0]=[/COLOR][COLOR=#0000FF]"robots"[/COLOR][COLOR=#FF0000] content[/COLOR][COLOR=#0000A0]=[/COLOR][COLOR=#0000FF]"noindex"[/COLOR][COLOR=#0000A0]>[/COLOR]
    that will disallow robots from indexing /cars/ but should let them index for exaple /cars/whatever/

    I hope it helps
     
  3. GreenDolla

    GreenDolla Regular Member

    Joined:
    Nov 13, 2009
    Messages:
    260
    Likes Received:
    74
    Occupation:
    Mobile
    Location:
    Atlanta
    socomm im so stupid platinum seo pack does this by default but i just wanted to use it in the robots.txt file instead, but im sticking with platinum seo pack for now thanks.
     
  4. silvertroll

    silvertroll Registered Member

    Joined:
    Mar 7, 2010
    Messages:
    76
    Likes Received:
    6
    Are you sure it counts as duplicate content?
     
  5. dsnking

    dsnking BANNED BANNED

    Joined:
    Dec 24, 2009
    Messages:
    129
    Likes Received:
    13
    so eh..what's the result? or conclusion?
     
  6. casius

    casius Junior Member

    Joined:
    Apr 18, 2010
    Messages:
    186
    Likes Received:
    20
    Home Page:
    Hello,

    A robots.txt file can create a vast impact on your WordPress blogs traffic and search engine rank. This is an SEO optimized WordPress robots.txt file. Remember that if you mess up the robots.txt file by overcrowding too much, you could misplace all of your rank.
     
  7. amsterdamned

    amsterdamned Regular Member

    Joined:
    Oct 13, 2009
    Messages:
    213
    Likes Received:
    46
    Thats a bit tricky as you woud have to stipulate all categories in your robots file:

    Disallow
    /cat
    /cat2

    etc.