<<how can i noindex wp pages bogging down my onpage seo?>>

entreprenuer · Jun 24, 2009

hey there,

just as the title says I need to noindex a bunch of wordpress pages bogging down my seo.

Pages like: "wp login" "error pages" and some weird pages I never even created are bogging down my onpage seo.

What can I do to prevent google from indexing these pages?

xhpdx · Jun 24, 2009

dunno if this will help now, but you should use robots.txt with contents like

Code:

User-agent: *
Disallow: /wp-admin
Disallow: /another
Disallow: /another2

this will make all robots (search engines, bots who obey robots.txt) not visit the subfolders from the file

more info about robots.txt standard

entreprenuer · Jun 24, 2009

xhpdx said:
dunno if this will help now, but you should use robots.txt with contents like

Code:

User-agent: * Disallow: /wp-admin Disallow: /another Disallow: /another2

this will make all robots (search engines, bots who obey robots.txt) not visit the subfolders from the file

more info about robots.txt standard

ah man youre so awesome! i added some thanks and reputation.

Now all I do is save the following text as a .txt file and place it in the .cgi-bin right?

if not where do i place the robots.txt?

xhpdx · Jun 24, 2009

yes make it a txt file and place it in www or public_html folder, so it will be yourdomain.com/robots.txt not yourdomain/cgi-bin/robots.txt which won't work

entreprenuer · Jun 24, 2009

xhpdx said:
yes make it a txt file and place it in www or public_html folder, so it will be yourdomain.com/robots.txt not yourdomain/cgi-bin/robots.txt which won't work

alright man. thanks again for the help.

I just successfully uploaded the robots.txt file through my ftp client.

check it out: hxxp://forexrobottrader.org/robots.txt

xhpdx · Jun 24, 2009

it looks good, but i am not quite sure whether a entry like

Code:

wp-login.php?redirect_to=

will be obeyed, cause of parameters

perhaps someone who knows more about robots.txt will say for sure

adamster · Jun 24, 2009

NO index No follow wp plugin:

Code:

http://wordpress.org/extend/plugins/noindex-archives/

This plugin works very well eventhough it wasn't updated since 2009-2-12. I recently upgraded about 40 sites using this plugin to wp 2.8 with no problem.

<<how can i noindex wp pages bogging down my onpage seo?>>

entreprenuer

Junior Member

xhpdx

Regular Member

entreprenuer

Junior Member

xhpdx

Regular Member

entreprenuer

Junior Member

xhpdx

Regular Member

adamster

Regular Member

Main Menu

Marketplace

Making Money

BlackHat World