Hello,
One of my websites pulls information from a Usenet newsgroup and allows my visitors to discuss about my niche in the newsgroup. The newsgroups is fairly active. I recently noticed that other sites are pulling from the same newsgroup, and Google Groups also shows articles from the newsgroup.
I don't have meta robots setup and Google has been crawling the web interface for about 6 months. I'm wondering if I should block these pages with robots nofollow, noindex in order to prevent a duplicate content penalty?
If you do an exact search for 99% of the articles are posted elsewhere on the Internet. Could this be hurting my SERP position? Would it be wise to block with meta robots? Or what would be the best way to prevent a duplicate content penalty / removal from the Google index?
-- Thank You
One of my websites pulls information from a Usenet newsgroup and allows my visitors to discuss about my niche in the newsgroup. The newsgroups is fairly active. I recently noticed that other sites are pulling from the same newsgroup, and Google Groups also shows articles from the newsgroup.
I don't have meta robots setup and Google has been crawling the web interface for about 6 months. I'm wondering if I should block these pages with robots nofollow, noindex in order to prevent a duplicate content penalty?
If you do an exact search for 99% of the articles are posted elsewhere on the Internet. Could this be hurting my SERP position? Would it be wise to block with meta robots? Or what would be the best way to prevent a duplicate content penalty / removal from the Google index?
-- Thank You