1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Robots.txt

Discussion in 'Black Hat SEO' started by garymoore321, Mar 25, 2013.

  1. garymoore321

    garymoore321 Newbie

    Joined:
    Mar 20, 2013
    Messages:
    3
    Likes Received:
    0
    what is Robots.txt and how it useful in SEO?? Can any one help on this??
     
  2. acedouble7

    acedouble7 Regular Member

    Joined:
    Dec 24, 2012
    Messages:
    268
    Likes Received:
    15
    hey check out wikipedia and type in robots.txt in there
     
  3. starway

    starway Registered Member

    Joined:
    Mar 21, 2013
    Messages:
    52
    Likes Received:
    12
    Location:
    Italy
    Google says

     
  4. Union

    Union Power Member

    Joined:
    Sep 24, 2011
    Messages:
    531
    Likes Received:
    210
    Location:
    USA
  5. civicsi_22657

    civicsi_22657 Newbie

    Joined:
    Nov 30, 2012
    Messages:
    10
    Likes Received:
    1
    also can i use robot.txt to hide certain databases ? s
     
  6. Schvamp

    Schvamp Power Member

    Joined:
    Feb 13, 2012
    Messages:
    684
    Likes Received:
    549
    Location:
    Hogwarts
    Your database is always hidden as long as you havent posted your login details in public.
     
  7. acedouble7

    acedouble7 Regular Member

    Joined:
    Dec 24, 2012
    Messages:
    268
    Likes Received:
    15
    yap....
     
  8. The SEO

    The SEO Jr. VIP Jr. VIP Premium Member

    Joined:
    Dec 14, 2011
    Messages:
    3,976
    Likes Received:
    3,115
    Occupation:
    SEO/SMM
    Location:
    BHW
    There are a lot of thread on Robots.txt, try to read the old thread by using search button.
     
  9. seochris96

    seochris96 Regular Member

    Joined:
    Jan 31, 2012
    Messages:
    331
    Likes Received:
    100
    Occupation:
    Writer, Designer, Marketer
    Location:
    2 spots away from the top of Google
    I mostly use robots to block bots from indexing my mobile content on the sites I have which aren't wordpress and have a duplicated site for mobile visitors. I'm not sure if it's the ideal way to go about it, but I figure it will help avoid duplicate content issues.