1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Any Body Using Vivvo CMS Script?

Discussion in 'White Hat SEO' started by bizroot, Aug 10, 2010.

  1. bizroot

    bizroot Supreme Member

    Joined:
    Feb 25, 2008
    Messages:
    1,345
    Likes Received:
    912
    Location:
    In My Computer
    I am stuck with my robots.txt...

    One of my site is facing problem... Google is indexing txt and print version of my articles also... I tried to block them from robots.txt but still same problem... I am unable to block bots from crawling and indexing them... Site got 1600+ unique article and now in webmaster I am seeing tons of duplication issue... It's affecting my overall ranking for this site...

    Anybody here using Vivvo CMS can help me out... How you are blocking bots to index txt and print version of articles...

    My robots.txt
    Code:
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /*.txt$
    Disallow: /*.html?print$
    Disallow: /admin/
    Disallow: /cache/
    Disallow: /feed/
    
     
  2. farhaty

    farhaty Junior Member

    Joined:
    Jun 27, 2010
    Messages:
    179
    Likes Received:
    126
    hello I will help you, add this y-- at h0tm4il fr
     
  3. bizroot

    bizroot Supreme Member

    Joined:
    Feb 25, 2008
    Messages:
    1,345
    Likes Received:
    912
    Location:
    In My Computer
    Thanks... Problem solved... Problem was created by courtesy of Hostgator... they have a bot which overwrites all robots.txt on their server...

    Only when I said I will move to some other host they changed it on my site and now no further txt and html version of my articles are getting indexed...