Noindex category pages

B

blogmarketer

Regular Member

Jul 17, 2023

333

180

• Oct 8, 2023

• #1

Hi

On my search console it says my category pages are being blocked by my robots file, but I don't see where?

My robot file has this

User-agent: Mediapartners-Google
Disallow:

User-agent: *
Disallow: /search
Allow: /

How do I allow my category pages to be indexed or should I not worry?

 

tiiberius

Elite Member

Executive VIP

Jr. VIP

Sep 8, 2015

5,603

5,430

• Oct 8, 2023

• #2

This message is sometimes false.

Use site: search operator to check if it is actually true. They might be indexed already just fine.

 

B

blogmarketer

Regular Member

Jul 17, 2023

333

180

• Oct 8, 2023
• Thread Starter Thread Starter

• #3

tiiberius said:

This message is sometimes false.

Use site: search operator to check if it is actually true. They might be indexed already just fine.

Click to expand...

Yeah I have done that but nah it is not indexed.

 

1SEOWarrior

Elite Member

Jr. VIP

Oct 29, 2021

8,409

3,595

• Oct 8, 2023

• #4

Have you manually checked it with site:yourdomain.com/shoes?

 

tiiberius

Elite Member

Executive VIP

Jr. VIP

Sep 8, 2015

5,603

5,430

• Oct 8, 2023

• #5

blogmarketer said:

Yeah I have done that but nah it is not indexed.

Click to expand...

Inspect the URL manually and then Test Live URL. See what that says.

 

B

blogmarketer

Regular Member

Jul 17, 2023

333

180

• Oct 8, 2023
• Thread Starter Thread Starter

• #6

tiiberius said:

Inspect the URL manually and then Test Live URL. See what that says.

Click to expand...

Yeah, comes up with red sign saying blocked by robot. file and cannot be indexed.

Is my robots txt file fine then?

 

Qayyum SEO

Newbie

Oct 9, 2023

6

1

• Oct 10, 2023

• #7

this massege show some time false or some time not working

 

tiiberius

Elite Member

Executive VIP

Jr. VIP

Sep 8, 2015

5,603

5,430

• Oct 19, 2023

• #8

blogmarketer said:

Yeah, comes up with red sign saying blocked by robot. file and cannot be indexed.

Is my robots txt file fine then?

Click to expand...

It can be misinterpretation. One time it happened to be that block was actually in .htaccess.

It's been a while. Were you able to fix this?

 

S

seo_sohail

Junior Member

Sep 23, 2023

184

67

• Oct 19, 2023

• #9

check your seo plugin setting

In most SEO plugins like Yoast SEO for WordPress, you can prevent search engines from indexing category pages by editing the specific category and setting the "Meta Robots Index" option to "Noindex."