1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Robot.txt- block Google Bot Need Help

Discussion in 'Blogging' started by hsh8255, Jul 17, 2009.

  1. hsh8255

    hsh8255 Registered Member

    Joined:
    Jul 10, 2009
    Messages:
    98
    Likes Received:
    8
    Occupation:
    homeless
    Location:
    earth
    I saw that someone was talking about blocking google bot not to crawl my wordpress plugins stuffs.

    how can i do that?

    Please give me any advice!

    Thank you.

    And any experiences are also welcome.
     
  2. hsh8255

    hsh8255 Registered Member

    Joined:
    Jul 10, 2009
    Messages:
    98
    Likes Received:
    8
    Occupation:
    homeless
    Location:
    earth
    hm.. i just did
    User-agent: *
    Disallow: /plugins/

    But i'm not sure about that...

    hm. I have addon domain and Does it really work for Subdomain?
     
  3. Sm_Art

    Sm_Art Junior Member

    Joined:
    May 23, 2009
    Messages:
    147
    Likes Received:
    43
    Location:
    Kepler 22b
    use webmaster tools help. it's easy
     
  4. Ueland

    Ueland Registered Member

    Joined:
    May 4, 2009
    Messages:
    97
    Likes Received:
    40
    and also add a index.html file in the plugins folder to keep people from looking into the folder, if you are paranoid enough.
     
  5. sonneti

    sonneti Regular Member

    Joined:
    Jan 27, 2009
    Messages:
    205
    Likes Received:
    127
    Rename your plugins, most of them will still work even when renamed & it makes them harder to find.
     
  6. SpamRaider

    SpamRaider Registered Member

    Joined:
    Mar 16, 2009
    Messages:
    83
    Likes Received:
    248
    Lots of tutorials for making your own robots.txt file just do a search on Google