1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Autoblog Plugins... How to protect myself?

Discussion in 'Blogging' started by bgallotte, Oct 27, 2009.

  1. bgallotte

    bgallotte Newbie

    Joined:
    Jul 29, 2009
    Messages:
    23
    Likes Received:
    3
    Location:
    London - UK
    I am starting to build some autoblogs and I am a bit concerned about how to protect myself from big G. crawls and robots.. I know this crawls and robots check everything in your page, including your plugins subdirectory.
    Whats the best way to protect myself from this check? Because once the spider get to my plugins they will know through the names that it is an autoblog...
    Does robots.txt works? I mean, will big G. respect it? or I should change each plugins subdirectories name and respectives php files?
    I dont know if I am being paranoid just would like some suggestions pls.:eek:
     
  2. cboolator

    cboolator Newbie

    Joined:
    Jul 29, 2009
    Messages:
    34
    Likes Received:
    0
    Location:
    Bochum
    All i know is that google accept robots.txt.
     
  3. bgallotte

    bgallotte Newbie

    Joined:
    Jul 29, 2009
    Messages:
    23
    Likes Received:
    3
    Location:
    London - UK
    Nobody else? :confused:
     
  4. hotcheats

    hotcheats Regular Member

    Joined:
    Dec 2, 2008
    Messages:
    328
    Likes Received:
    74
    Location:
    EU
    I think you're just being a little paranoid, personally I have lots of autoblogs and never cared about it...but if you really insist, create in Notepad a file named ".htaccess" and upload it to main folder of your wordpress installation:

    Code:
    < Directory /wp-content/plugins/>
    Order deny,allow
    Deny from all
    </Directory>
    You can also (if you already haven't) upload a robots.txt file with the following:
    Code:
    Sitemap: /sitemap.xml
    
    User-agent: *
    Disallow: /wp-content/cache/
    Disallow: /wp-content/themes/
    Disallow: /wp-content/plugins/
    Disallow: /wp-admin/
    Disallow: /wp-includes/
    Disallow: /wp-login.php 
     
    • Thanks Thanks x 1
  5. bangus

    bangus Newbie

    Joined:
    Jan 19, 2009
    Messages:
    24
    Likes Received:
    1
    your over reacting.. you need some .htaccess and robot.txt
     
  6. bgallotte

    bgallotte Newbie

    Joined:
    Jul 29, 2009
    Messages:
    23
    Likes Received:
    3
    Location:
    London - UK
    I created the .htaccess file like you said and uploaded it and it gave me a 500 Internal Server Error, everything came back to normal after I deleted the .htaccess.
    Did I do anything wrong? My hosting is Dreamhost Linux Based so I think it is not the problem.

     
  7. devilster

    devilster Registered Member

    Joined:
    Mar 30, 2009
    Messages:
    91
    Likes Received:
    5
    Location:
    U.K.
    ah thanks that what i was looking for!
    thanks dude!
     
  8. hotcheats

    hotcheats Regular Member

    Joined:
    Dec 2, 2008
    Messages:
    328
    Likes Received:
    74
    Location:
    EU
    You can also put .htaccess with only this:
    Code:
    Order allow,deny
    Deny from all
    
    In the directory "/wp-content/plugins/" - where you keep the plugins. For some reason the first version doesn't work always on some hosts...
     
  9. NoSuchAgency

    NoSuchAgency Junior Member

    Joined:
    Oct 14, 2009
    Messages:
    124
    Likes Received:
    61
    If you use htaccess and robots.txt you'll prevent good bots like Google's from crawling the directories you list. So just do what was mentioned above and you should be set.