Hey guys i need help

[rapkishor]

Hey i guys whenever I post something on my website I faced this problem on every post "Page indexing: Page is not indexed: Excluded by ‘noindex’ tag" can anyone tell me how to fix this problem.

 

[Richichi]

Your robots.txt is blocking indexation.
You need to edit that file or download something like rankmath seo which can do it for you.

 

[tiiberius]

The pages themselves are preventing indexation.

It looks something like this. Remove the highlighted part:

<meta name="robots" content="noindex, nofollow" />

 

[rapkishor]

The pages themselves are preventing indexation.

It looks something like this. Remove the highlighted part:

<meta name="robots" content="noindex, nofollow" />

<meta name='robots' content='index, follow, max-image-preview:large, max-snippet:-1, max-video-preview:-1' />

 

[rapkishor]

Your robots.txt is blocking indexation.
You need to edit that file or download something like rankmath seo which can do it for you.

User-agent: *
Disallow:
Disallow: /cgi-bin/

 

[mrneedles]

User-agent: *
Disallow:
Disallow: /cgi-bin/

why do you have an empty Disavow: ?

 

[rapkishor]

hello

hey

 

[rapkishor]

why do you have an empty Disavow: ?

then tell me the rigit robot txt code

 

[googgle]

@OP, Did u get it fixed?

 

[mrneedles]

then tell me the rigit robot txt code

Go with the following, no need to specify an emty disallow here:

User-agent: *
Disallow: /cgi-bin/

Also, check again if you have noindex in your HTML or if your server gives noindex directive.

 

[Aureus]

User-agent: *
Disallow:
Disallow: /cgi-bin/

remove "Disallow:" line

 

[rapkishor]

Go with the following, no need to specify an emty disallow here:

User-agent: *
Disallow: /cgi-bin/

Also, check again if you have noindex in your HTML or if your server gives noindex directive.

done

 

[dragonlube]

done

Got right?

 

[rapkishor]

Got right?

waiting for crawl

 

[rapkishor]

Go with the following, no need to specify an emty disallow here:

User-agent: *
Disallow: /cgi-bin/

Also, check again if you have noindex in your HTML or if your server gives noindex directive.

dude nothing change same issue

 

[mrneedles]

dude nothing change same issue

Then the problem is not with your robots.txt. Check if you block Google with your HTML or your HTTP headers.

Also, Google must re-visit your affected pages in the first place.

 

[Steptoe]

Have you requested indexing again after updating your robots.txt file?

 

[rapkishor]

Have you requested indexing again after updating your robots.txt file?

yes

 

[rapkishor]

Then the problem is not with your robots.txt. Check if you block Google with your HTML or your HTTP headers.

Also, Google must re-visit your affected pages in the first place.

can u tell me how check