1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What settings do you recommend for htaccess and robot.txt files to camoflage WP-robot

Discussion in 'Blogging' started by skywalker55, Jan 27, 2011.

  1. skywalker55

    skywalker55 Junior Member

    Joined:
    Jan 29, 2010
    Messages:
    123
    Likes Received:
    109
    Occupation:
    Web App Development
    Location:
    London
    I cant ignore the constant output from google about clamping down on automatically generated content. They mentioned it again on their adsense email update today.

    So with that in mind I wondered if some of the Wp-Robot pros's would mind sharing there strategies for camoflaging WP-robots existance on a site.

    What code are you using in the robot file file and also in your htaccess file ??

    Also do you have any other suggestions or strategies for staying under the radar ?

    Thanks
     
  2. wickedguy

    wickedguy Supreme Member

    Joined:
    Jul 22, 2009
    Messages:
    1,402
    Likes Received:
    1,379
    Location:
    BHW--> South Africa
    Home Page:
    create an .htaccess file and paste the following code inside it. Then upload it to the plugins directory

     
    • Thanks Thanks x 20
  3. newnetworks

    newnetworks Junior Member

    Joined:
    Jun 14, 2010
    Messages:
    109
    Likes Received:
    1,417
    consistently good advice from you wickedguy.
    spot on.
    thanks

    ps. i was getting frustrated with your rep
    sitting at 99 for so long, so
    99 + 1 = 100 lol ;)
     
    • Thanks Thanks x 2
  4. skywalker55

    skywalker55 Junior Member

    Joined:
    Jan 29, 2010
    Messages:
    123
    Likes Received:
    109
    Occupation:
    Web App Development
    Location:
    London
    Thanks Wickedguy....Much appreciated
     
  5. dashndash

    dashndash Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 18, 2008
    Messages:
    408
    Likes Received:
    70
    Location:
    Depends on the proxy
    What does it actually do? I dun kno nythg abt .htaccess files :D
     
  6. wickedguy

    wickedguy Supreme Member

    Joined:
    Jul 22, 2009
    Messages:
    1,402
    Likes Received:
    1,379
    Location:
    BHW--> South Africa
    Home Page:
    it keeps bots and prying eyes outside your plugins folder :D
     
    • Thanks Thanks x 1
  7. skywalker55

    skywalker55 Junior Member

    Joined:
    Jan 29, 2010
    Messages:
    123
    Likes Received:
    109
    Occupation:
    Web App Development
    Location:
    London
    I have now added it to all my sites. But all have been previously indexed and receiving alot of search traffic from google. Do you think google keeps a record of my previous plugin dirrectory before I added the .htaccess file ?

    My adsense income has increased dramatically over the last month or so. So I imagine im going to have my sites "manually inspected" before I get my next payment from them. Do you have any suggestions/ recommendations ?
     
  8. wickedguy

    wickedguy Supreme Member

    Joined:
    Jul 22, 2009
    Messages:
    1,402
    Likes Received:
    1,379
    Location:
    BHW--> South Africa
    Home Page:
    if you used a robot.txt and big G is honest they won't have a record. The htaccess is just better security, that's all.

    Robots.txt is not security, it's shit! :D

    If you tell a bot not to index or visit certain areas on your site, it just makes one curious, don't you think? Even I can access your robots.txt with my browser.

    If I notice that you protect a certain directory (plugins) I just might wanna have a look.

    There's another security issue when it comes to wordpress. A cookie file can get your site hacked! Believe it or not, it happened to me. LOL!

    Here's some code I use in my htaccess in my public_html to prevent that

    SO ANYONE TRYING TO PEEK INTO THE COOKIE FILE WILL BE REDIRECTED TO THE HOME PAGE

    :D
     
    • Thanks Thanks x 9
  9. blackwp

    blackwp Junior Member

    Joined:
    Jan 27, 2011
    Messages:
    108
    Likes Received:
    18
    Occupation:
    Knucklehead University
    Location:
    Europe
    Wickedguy thanks a lot, just I already have a .htaccess file in public_html, so could I just add the above code to it?
     
  10. wickedguy

    wickedguy Supreme Member

    Joined:
    Jul 22, 2009
    Messages:
    1,402
    Likes Received:
    1,379
    Location:
    BHW--> South Africa
    Home Page:
    yes, add it at the top of the htaccess
     
    • Thanks Thanks x 1
  11. divinity

    divinity Junior Member

    Joined:
    Jul 9, 2009
    Messages:
    126
    Likes Received:
    20
    A quick search on google tells me that you add the line below to your .htaccess file.

    Options -Indexes
     
  12. adbox

    adbox Power Member

    Joined:
    May 1, 2009
    Messages:
    658
    Likes Received:
    107
    Home Page:
    Hello,

    If I placed this inside a directory accessed by the wordpress psudocron would it mal affect the process in any way?

    Could you explain the code a bit possibly?
     
  13. wickedguy

    wickedguy Supreme Member

    Joined:
    Jul 22, 2009
    Messages:
    1,402
    Likes Received:
    1,379
    Location:
    BHW--> South Africa
    Home Page:
    If the cron is called like via a browser like say for instance http ://s it e . com/ wp-cron.php, the cron won't work, but if wordpress call the cron like /home/username/wp-cron.php the cron will work

    So basically, the cron should not be called via http
     
  14. BenQs

    BenQs Regular Member

    Joined:
    Jun 12, 2009
    Messages:
    265
    Likes Received:
    39
    Gender:
    Male
    You're saying place an .htaccess in the plugins directory?
     
  15. 247profits

    247profits Newbie

    Joined:
    May 13, 2009
    Messages:
    20
    Likes Received:
    226
    Thanks for this snippet of code.
     
  16. 247profits

    247profits Newbie

    Joined:
    May 13, 2009
    Messages:
    20
    Likes Received:
    226
    Thanks for this snippet as well
     
  17. blackwp

    blackwp Junior Member

    Joined:
    Jan 27, 2011
    Messages:
    108
    Likes Received:
    18
    Occupation:
    Knucklehead University
    Location:
    Europe
    I uploaded the *htaccess file in the plugin directory, but than my wp-admin and even my posts are password protected??? Just don't know what I'm doing wrong:( Can somebody point me to the right direction, many thanks
     
  18. blackcatgill

    blackcatgill Registered Member

    Joined:
    Dec 15, 2010
    Messages:
    86
    Likes Received:
    5

    i uploaded the code aswell , couldnt get onto my blogs , as a box popped up asking for username and password etc.Changed them all back now to the original code untill i find out where im going wrong :)
     
  19. dashndash

    dashndash Jr. VIP Jr. VIP Premium Member

    Joined:
    Jan 18, 2008
    Messages:
    408
    Likes Received:
    70
    Location:
    Depends on the proxy

    I got a problem after uploading .htaccess file to /plugins/ directory.. WP Follow me ain't working anymore!! The box is appearing but graphics gone!! then when I delete the .htaccess file from plugins/ folder, it works perfectly. .

    Any idea? :D
     
  20. wickedguy

    wickedguy Supreme Member

    Joined:
    Jul 22, 2009
    Messages:
    1,402
    Likes Received:
    1,379
    Location:
    BHW--> South Africa
    Home Page:
    ok, guys, a less secure but also good idea is to create a blank index.php and upload it to the plugins directory. SEE?

    All problems solved in a jiffy! :D