1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

how to fix Robots.txt fetch error in Webmaster tools?

Discussion in 'White Hat SEO' started by Alieve, Jul 25, 2014.

  1. Alieve

    Alieve Junior Member

    Joined:
    Nov 1, 2012
    Messages:
    186
    Likes Received:
    38
    Occupation:
    SEO Consultant
    Location:
    <<< ereh em dnif
    Home Page:
    Can some one help me with Robots.txt fetch error in web master tools?
    I have tried to change the robot txt after doing this I have test it with Robot tester in webmaster tool and its working fine but I am still having fetch error in webmaster tool
     
  2. allroy

    allroy Registered Member

    Joined:
    Aug 4, 2013
    Messages:
    67
    Likes Received:
    18
    Have you tried the "Fetch as Googlebot" tool in webaster tools? Try fetching the robots.txt and see if it's still unreachable. Maybe you have something in .htaccess blocking it?
     
  3. Flask

    Flask Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 7, 2014
    Messages:
    133
    Likes Received:
    17
    What does the error say?
     
  4. SEO Power

    SEO Power Elite Member

    Joined:
    Jul 14, 2014
    Messages:
    2,637
    Likes Received:
    680
    Occupation:
    Self employed
    Location:
    Houston, TX
    By now the error should no longer be there because Google updates the robot.txt files of every website once in a day. So next time you encounter this issue, wait until the next day.