1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Usenet web gateway - Duplicate content

Discussion in 'Black Hat SEO' started by googleme7, Nov 29, 2011.

  1. googleme7

    googleme7 Newbie

    Joined:
    Jan 13, 2010
    Messages:
    35
    Likes Received:
    3
    Occupation:
    Internet Marketing
    Location:
    USA
    Home Page:
    Hello,

    One of my websites pulls information from a Usenet newsgroup and allows my visitors to discuss about my niche in the newsgroup. The newsgroups is fairly active. I recently noticed that other sites are pulling from the same newsgroup, and Google Groups also shows articles from the newsgroup.

    I don't have meta robots setup and Google has been crawling the web interface for about 6 months. I'm wondering if I should block these pages with robots nofollow, noindex in order to prevent a duplicate content penalty?

    If you do an exact search for 99% of the articles are posted elsewhere on the Internet. Could this be hurting my SERP position? Would it be wise to block with meta robots? Or what would be the best way to prevent a duplicate content penalty / removal from the Google index?

    -- Thank You