wordpress duplicate problem

c0ntenth|ef · Sep 10, 2009

when i check all the indexed pages of my wordpress blog in google, there are some indexed pages that are like this www,blog,com/page/1,www,blog,com/page/2 and so on..... the indexed text after the title are the summary of my different posts but the title of all those page/1/2/3 is the same (main blog title) so i dont want my blog to be penalized for duplicate content,so is there anywayto the pages from being indexed like that? i have all-in-one-seo plugin too and as far as i know i set up most of the options that could make diplicate content to 'noindex'.

xpressioniz · Sep 10, 2009

You can use robots.txt to disallow search engine from reaching those pages. No need for plugins.

Inside robots.txt:

User-agent: *
Disallow: /page/

Create this file by using notepad and upload it to ftp to your public_html folder

c0ntenth|ef · Sep 10, 2009

yeah i was thinking that too just didn't know how to write the command in te robot.txt thanks

keinehabe · Sep 10, 2009

title of the page aren't means you have duplicate content

spiders know ''how to read '' subsequent pages / multiple pages

how and from where?

... guess yourself lol ...

c0ntenth|ef · Sep 14, 2009

hmm maybe but titles are part of the content too so if i add more posts and it adds up like this page/1/2/3/4 etc... and all have the same title google might see it as dublicates.

boiler · Sep 14, 2009

keinehabe said:
title of the page aren't means you have duplicate content spiders know ''how to read '' subsequent pages / multiple pages how and from where? ... guess yourself lol ...

correct because my site is like that which having domain.com/page/1 domain.com/page/2 and google even giving me PR 3 on root domain

xpressioniz · Sep 16, 2009

c0ntenth|ef said:
hmm maybe but titles are part of the content too so if i add more posts and it adds up like this page/1/2/3/4 etc... and all have the same title google might see it as dublicates.

Yes, those are duplicate contents according to Google Webmaster Tools. The pages don't contain any useful info, just a couple of links and this might indicate a low quality content in the eyes of the big G. I'd suggest you do the robots.txt I told you above to remove the page from the index. You'll have a major problems on bigger sites (I've been there on 200k+ indexes) if you keep those "junk" pages. Problems such as sandboxes, slow crawling, wrong SERPs, etc. You definitely want to avoid that. I guess on very small blog with just a few posts this is not a big deal though.

wowhaxor · Sep 16, 2009

xpressioniz said:
Yes, those are duplicate contents according to Google Webmaster Tools. The pages don't contain any useful info, just a couple of links and this might indicate a low quality content in the eyes of the big G. I'd suggest you do the robots.txt I told you above to remove the page from the index. You'll have a major problems on bigger sites (I've been there on 200k+ indexes) if you keep those "junk" pages. Problems such as sandboxes, slow crawling, wrong SERPs, etc. You definitely want to avoid that. I guess on very small blog with just a few posts this is not a big deal though.

I disagree. I think one of the many benefits of WP as a platform is that it creates all kinds of pages like these to help your site get crawled better, WP performs very will in SEs in terms of onsite SEO.

xpressioniz · Sep 16, 2009

wowhaxor said:
I disagree. I think one of the many benefits of WP as a platform is that it creates all kinds of pages like these to help your site get crawled better, WP performs very will in SEs in terms of onsite SEO.

You can still use category pages (still, add noindex to it) to backward-crawl google by using breadcrumb, but pages, don't bother. I do agree that WP performs very well, but I think onsite SEO depends on what template you are using.

The problem with these kind of pages is, you can't add noindex to it by using plugins such as All-In-One SEO (as far as I know), but you can add noindex to category and tags pages without having to modify the template files. So robots.txt is one solution to it. By adding noindex, google still crawl and follow pages (assuming the meta tag: noindex, follow).

wordpress duplicate problem

c0ntenth|ef

Power Member

xpressioniz

Junior Member

c0ntenth|ef

Power Member

keinehabe

Supreme Member

c0ntenth|ef

Power Member

boiler

Senior Member

xpressioniz

Junior Member

wowhaxor

Elite Member

xpressioniz

Junior Member

Main Menu

Marketplace

Making Money

BlackHat World