Robots.txt

Discussion in 'Black Hat SEO' started by garymoore321, Mar 25, 2013.

  1. garymoore321

    garymoore321 Newbie

    Joined:
    Mar 20, 2013
    Messages:
    3
    Likes Received:
    0
    what is Robots.txt and how it useful in SEO?? Can any one help on this??
     
  2. acedouble7

    acedouble7 Regular Member

    Joined:
    Dec 24, 2012
    Messages:
    268
    Likes Received:
    16
    hey check out wikipedia and type in robots.txt in there
     
  3. starway

    starway Registered Member

    Joined:
    Mar 21, 2013
    Messages:
    52
    Likes Received:
    12
    Location:
    Italy
    Google says

     
  4. Union

    Union Power Member

    Joined:
    Sep 24, 2011
    Messages:
    531
    Likes Received:
    210
    Location:
    USA
  5. civicsi_22657

    civicsi_22657 Newbie

    Joined:
    Nov 30, 2012
    Messages:
    10
    Likes Received:
    1
    also can i use robot.txt to hide certain databases ? s
     
  6. Schvamp

    Schvamp Power Member

    Joined:
    Feb 13, 2012
    Messages:
    684
    Likes Received:
    551
    Location:
    Hogwarts
    Your database is always hidden as long as you havent posted your login details in public.
     
  7. acedouble7

    acedouble7 Regular Member

    Joined:
    Dec 24, 2012
    Messages:
    268
    Likes Received:
    16
    yap....
     
  8. The SEO

    The SEO Jr. VIP Jr. VIP

    Joined:
    Dec 14, 2011
    Messages:
    4,498
    Likes Received:
    3,266
    Gender:
    Male
    Occupation:
    SEO/SMM
    Location:
    BHW
    Home Page:
    There are a lot of thread on Robots.txt, try to read the old thread by using search button.
     
  9. seochris96

    seochris96 Regular Member

    Joined:
    Jan 31, 2012
    Messages:
    332
    Likes Received:
    101
    Occupation:
    Writer, Designer, Marketer
    Location:
    2 spots away from the top of Google
    I mostly use robots to block bots from indexing my mobile content on the sites I have which aren't wordpress and have a duplicated site for mobile visitors. I'm not sure if it's the ideal way to go about it, but I figure it will help avoid duplicate content issues.