1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Blocking Googlebot By accident

Discussion in 'Black Hat SEO' started by mainceaft, May 14, 2014.

  1. mainceaft

    mainceaft Regular Member

    Joined:
    Apr 10, 2013
    Messages:
    373
    Likes Received:
    39
    Hi all
    I just want to warn everyone who block alot of bots from their site to make sure Googlebot not blocked
    today went to one of my sites and I notice last visit from Googlebot was from almost a week .
    I checked .htaccess and i found wrong code that blocking Googlebot ouch ..
    to prevent this to anyone else I suggest use user-agent-switcher firefox addon
    and add this new user-agent :-
    Code:
    Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    Code:
    Mozilla/5.0 (iPhone; CPU iPhone OS 6_0 like Mac OS X) AppleWebKit/536.26 (KHTML, like Gecko) Version/6.0 Mobile/10A5376e Safari/8536.25 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
    Complete List here
    https://support.google.com/webmasters/answer/1061943?hl=en
    And test your site using user-agent-switcher .
    I hope this helps .
     
  2. Numbuh362

    Numbuh362 Elite Member

    Joined:
    Aug 22, 2012
    Messages:
    1,569
    Likes Received:
    462
    Good thing that you caught that, I probably should start blocking bots too.