1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Googlebot can't access your site

Discussion in 'Black Hat SEO' started by Desert90, Dec 26, 2012.

  1. Desert90

    Desert90 Jr. VIP Jr. VIP

    Joined:
    Sep 23, 2012
    Messages:
    766
    Likes Received:
    126
    Location:
    BHW
    Somebody knows what does that mean ?

    This is the error:

    Over the last 24 hours, Googlebot encountered 1 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 100.0%.
    You can see more details about these errors in Webmaster Tools.

    Does that mean google cant index my website ? what hsould i do?
     
  2. davids355

    davids355 Jr. VIP Jr. VIP Premium Member

    Joined:
    Apr 25, 2011
    Messages:
    8,794
    Likes Received:
    6,335
    Home Page:
    Most likely cause is that your site was I un-available - like maybe your hosting was down.
     
  3. Endire

    Endire Elite Member Premium Member

    Joined:
    Mar 27, 2012
    Messages:
    1,756
    Likes Received:
    1,061
    Gender:
    Male
    Desert90,

    This is most likely an error with your robots.txt file. Either the file is not configured correctly or there is some other URL (http request) in your code that Googlebot is following and referencing a robtots.txt file there. For instance there are sometimes third party URL's in WP themes that can make this error appear.

    As to whether this means your entire site can or cannot be indexed, the error should tell you this. Either there is one page the bot cannot access or it cannot index any pages. I would take a look at your robots file or look at your source code to see if there are any other third party URLs there.

    You may also be able to find a solution here,

    http://support.google.com/webmasters/bin/answer.py?hl=en&answer=35738

    Hope that helps,

    Shawn
     
  4. John_SE

    John_SE Junior Member

    Joined:
    Mar 22, 2012
    Messages:
    122
    Likes Received:
    18
    Location:
    UK
    exactly as they said above.. if you did nothing to ur site. could be your server. If you did something you could have blocked it in the robot.txt
    if you have just launched your site. Check the robot txt and privacy if it is a wordpress site.

    go to your "Blocked URLs" in webmaster tools to find out more

     
  5. Desert90

    Desert90 Jr. VIP Jr. VIP

    Joined:
    Sep 23, 2012
    Messages:
    766
    Likes Received:
    126
    Location:
    BHW
    Thank you for your help .

    I dont have blocked URLs . But where do i find the robots.txt file?
    And this is not a WP site...

    It's a site from LBrowns amazon keyword service (EMD)
     
  6. stariher

    stariher Registered Member

    Joined:
    Mar 20, 2012
    Messages:
    75
    Likes Received:
    26
    this happen most times because of many reasons1-you change the domain or hosting2- your hosting down or they moved your site to a new server
     
  7. Desert90

    Desert90 Jr. VIP Jr. VIP

    Joined:
    Sep 23, 2012
    Messages:
    766
    Likes Received:
    126
    Location:
    BHW
    Ok they did not found the robots.txt file
    I have now created a file and uploaded it to the server
    it contains:

    User-agent: *
    Disallow:

    I think now its ok ..

    @mert : what do u mean ? no its not a +18 site...