how to fix this error

L

Learning SEO

Power Member

Jul 20, 2019

793

67

• Dec 12, 2019

• #1

My website is not indexing how to fix this error please can some one help me

URL is not available to Google

Availability
Blocked by robots.txt

Crawled as
Googlebot smartphone
Crawl allowed?

No: blocked by robots.txt
Page fetch

Failed: Blocked by robots.txt
Indexing allowed?
N/A

 

TomTheCat

Elite Member

Oct 27, 2019

2,371

2,751

• Dec 12, 2019

• #2

Check your robots.txt.

 

Sweely

Elite Member

Jun 7, 2009

1,519

1,338

• Dec 12, 2019

• #3

You've blocked the crawler in your Robots.txt. Check it out (or use a plugin for it if you don't know what's in there).

 

SpongeR0b

Registered Member

Nov 20, 2019

82

40

• Dec 12, 2019

• #4

https://support.google.com/webmasters/answer/6062596?hl=en

A little insight from Google into Robots.txt

 

L

Learning SEO

Power Member

Jul 20, 2019

793

67

• Dec 12, 2019

• #5

Sweely said:

You've blocked the crawler in your Robots.txt. Check it out (or use a plugin for it if you don't know what's in there).

Click to expand...

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.mywebsite.com/sitemap.xml


its like this so is it correct or wrong ?

 

Sweely

Elite Member

Jun 7, 2009

1,519

1,338

• Dec 12, 2019

• #6

In regards to what page on your site is Google displaying this error message? Is nothing being indexed by Google at all?

How new is the site, and how much content do you have on it?

 

Ajeet Ghuman

Power Member

Apr 21, 2018

548

359

• Dec 12, 2019

• #7

Learning SEO said:

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.mywebsite.com/sitemap.xml


its like this so is it correct or wrong ?

Click to expand...

that's a weird url you got there.. lol .. just delete the robot.txt file.. if you don't want disallow any url .. and if you want to disallow some urls just go through google guideline for doing it..

 

P

Perfect Nightmare

BANNED

Dec 11, 2019

28

7

• Dec 12, 2019

• #8

Just disable robots.txt

 

L

Learning SEO

Power Member

Jul 20, 2019

793

67

• Dec 12, 2019

• #9

Sweely said:

In regards to what page on your site is Google displaying this error message? Is nothing being indexed by Google at all?

How new is the site, and how much content do you have on it?

Click to expand...

very very old website already indexed many links on google first time today i created analytics and master tool