robots.txt wordpress seo

GreenDolla

Regular Member

Nov 13, 2009

260

75

• Apr 25, 2010

• #1

i need a little help im using this as my permalinks /%category%/%postname%/ and plugin top level categories it takes out the category before the category name..now im trying to perfect all seo factors so i would like to dis allow all categories from being indexed so i don't have any dup content..but i don't know how to do it if i disallow the category would it not let my pages be indexed..can some one show me an example on how to do it..lets say my category is cars how would it look thanks

 

S

socomm

Newbie

Mar 30, 2010

2

0

• Apr 26, 2010

• #2

If you can edit the html of /cars/ for example add the following between the head tags:

Code:

[COLOR=#0000A0]<[/COLOR][COLOR=#B22222]meta[/COLOR] [COLOR=#FF0000]name[/COLOR][COLOR=#0000A0]=[/COLOR][COLOR=#0000FF]"robots"[/COLOR][COLOR=#FF0000] content[/COLOR][COLOR=#0000A0]=[/COLOR][COLOR=#0000FF]"noindex"[/COLOR][COLOR=#0000A0]>[/COLOR]

that will disallow robots from indexing /cars/ but should let them index for exaple /cars/whatever/

I hope it helps

 

GreenDolla

Regular Member

Nov 13, 2009

260

75

• Apr 26, 2010
• Thread Starter Thread Starter

• #3

socomm im so stupid platinum seo pack does this by default but i just wanted to use it in the robots.txt file instead, but im sticking with platinum seo pack for now thanks.

 

silvertroll

Registered Member

Mar 7, 2010

76

6

• Apr 26, 2010

• #4

Are you sure it counts as duplicate content?

 

D

dsnking

BANNED

Dec 24, 2009

129

13

• Apr 26, 2010

• #5

so eh..what's the result? or conclusion?

 

C

casius

Junior Member

Apr 18, 2010

186

20

• Apr 26, 2010

• #6

Hello,

A robots.txt file can create a vast impact on your WordPress blogs traffic and search engine rank. This is an SEO optimized WordPress robots.txt file. Remember that if you mess up the robots.txt file by overcrowding too much, you could misplace all of your rank.

 

amsterdamned

Regular Member

Oct 13, 2009

224

49

• Apr 26, 2010

• #7

Thats a bit tricky as you woud have to stipulate all categories in your robots file:

Disallow
/cat
/cat2

etc.