Googlebot can't access your site? (Robots file included)

P

Patrick2014

Junior Member

Mar 7, 2014

151

25

• Nov 25, 2015

• #1

Googlebot can't access your site

Over the last 24 hours, Googlebot encountered 1 errors while attempting to access your robots.txt. To ensure that we didn't crawl any pages listed in that file, we postponed our crawl. Your site's overall robots.txt error rate is 100.0%.

• If you are able to access it from your browser, then your site may be configured to deny access to googlebot. Check the configuration of your firewall and site to ensure that you are not denying access to googlebot.
• If your robots.txt is a static page, verify that your web service has proper permissions to access the file.
• If your robots.txt is dynamically generated, verify that the scripts that generate the robots.txt are properly configured and have permission to run. Check the logs for your website to see if your scripts are failing, and if so attempt to diagnose the cause of the failure.

I received this error, I checked my robots file in browser and it is this..
I have 4 other websites on server and they have had no problem?

Code:

User-agent: *
Disallow: /wp-admin/

Sitemap: http://www.******.org/sitemap.xml.gz

Sitemap: http://www.******.org/sitemap.xml

 

CrazyBuddy

Power Member

Jun 23, 2013

681

224

• Nov 25, 2015

• #2

if you are using the same robots.txt , then 100% it is due to server downtime..which hosting company are you with

 

W

wesleyjf91

Registered Member

Sep 24, 2015

59

14

• Nov 26, 2015

• #3

Are you running any security plugins through a CMS?

Those could be blocking bots. Could be server issues.

 

D

Deleted member 708208

Guest

• Nov 26, 2015

• #4

I had this issue too because of a server issue like mentioned above. The only other time it happened was
from a plugin that wasn't working properly. It also takes a bit of time for this issue to resolve on Googles side.