Help Needed: Excluded Pages on Google Search Console

[Postie12345]

Google Search Console has excluded over 90 pages on my Wordpress site which i need indexing again. My site was very well ranked in Google (Rank 1) for years but for some reason its now lost 70% visibility and the error comes up as (Pages With Redirect). i haven't changed anything in the site but it looks as though its been going on for 6 to 8 weeks now.

Can anyone help me sort this problem out

 

[Starblazer]

You need to check if you can manually access these pages in a web browser. Just copy-paste 4-5 links of error pages and verify that they are loading normally. If everything is working fine, please share the exact error message from the search console, so that we can help you.

 

[HustleTong]

Make sure you didn't set them to noindex
(There's one in WordPress settings as well)

 

[Postie12345]

You need to check if you can manually access these pages in a web browser. Just copy-paste 4-5 links of error pages and verify that they are loading normally. If everything is working fine, please share the exact error message from the search console, so that we can help you.

Thanks For your comments. I tested 5 pages and all show the pages when searched for in Google, in the console it states: URL is not on Google. If i inspect it, then Test it, then it shows as live and i can request indexing. Is that normal?

 

[Starblazer]

You have 93 URLs excluded. Check for the reason why they are excluded.

Google search console gives redirect error if your site is https and you're checking for http version of the URL. You should check robots.txt to see if you've set any URLs or sub-folders to disallow. Also check your htaccess file to see if you've blocked anything.

 

[Postie12345]

You need to check if you can manually access these pages in a web browser. Just copy-paste 4-5 links of error pages and verify that they are loading normally. If everything is working fine, please share the exact error message from the search console, so that we can help you.

Make sure you didn't set them to noindex
(There's one in WordPress settings as well)

Thanks, i will have a look.

 

[Postie12345]

You have 93 URLs excluded. Check for the reason why they are excluded.

Google search console gives redirect error if your site is https and you're checking for http version of the URL. You should check robots.txt to see if you've set any URLs or sub-folders to disallow. Also check your htaccess file to see if you've blocked anything.

Thanks, this is above my knowledge of websites. My site is HTTPS, however i am sure i have some HTTP links from a few years ago that were redirected at some point but i have never done this. Is the below of any use?.

I did find this in the Rpbot.txt:
User-agent: *
Disallow: /_mm/
Disallow: /_notes/
Disallow: /_baks/
Disallow: /MMWIP/

User-agent: googlebot
Disallow: *.csi


This is the message on Test Robot.
User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

 

[Postie12345]

You have 93 URLs excluded. Check for the reason why they are excluded.

Google search console gives redirect error if your site is https and you're checking for http version of the URL. You should check robots.txt to see if you've set any URLs or sub-folders to disallow. Also check your htaccess file to see if you've blocked anything.

Thanks, please ignore my previous post and thanks for all the help today, i believe i am starting to understand the problem, i found the htacess file and i can not see anything blocked but it does state it will overwrite:see below

RewriteEngine On
RewriteCond %{HTTPS} !=on
RewriteRule ^(.*)$ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301,NE]

# BEGIN WordPress
# The directives (lines) between "BEGIN WordPress" and "END WordPress" are
# dynamically generated, and should only be modified via WordPress filters.
# Any changes to the directives between these markers will be overwritten.
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteRule .* - [E=HTTP_AUTHORIZATION:%{HTTP:Authorization}]
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

# END WordPress

============================================
If i am right i believe the wordpress address & site address are HTTPS as is the Security Certificate. I did find how to edit the Robot.txt file editor which does state the following but i wouldn't know how to edit it. You are right that the Google Search Engine is indeed looking (Google search console gives redirect error if your site is https and you're checking for http version of the URL) All the URLs are HTTP that have not been indexed. However when i look at the Permalink it states HTTPS even though Google has this as HTTP.

How is this changed?


robot. txt File Editor Text

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Am i on the right track?

Thanks in advance.

 

[Starblazer]

Thanks, please ignore my previous post and thanks for all the help today, i believe i am starting to understand the problem, i found the htacess file and i can not see anything blocked but it does state it will overwrite:see below

RewriteEngine On
RewriteCond %{HTTPS} !=on
RewriteRule ^(.*)$ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301,NE]

# BEGIN WordPress
# The directives (lines) between "BEGIN WordPress" and "END WordPress" are
# dynamically generated, and should only be modified via WordPress filters.
# Any changes to the directives between these markers will be overwritten.
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteRule .* - [E=HTTP_AUTHORIZATION:%{HTTP:Authorization}]
RewriteBase /
RewriteRule ^index\.php$ - [L]
RewriteCond %{REQUEST_FILENAME} !-f
RewriteCond %{REQUEST_FILENAME} !-d
RewriteRule . /index.php [L]
</IfModule>

# END WordPress

============================================
If i am right i believe the wordpress address & site address are HTTPS as is the Security Certificate. I did find how to edit the Robot.txt file editor which does state the following but i wouldn't know how to edit it. You are right that the Google Search Engine is indeed looking (Google search console gives redirect error if your site is https and you're checking for http version of the URL) All the URLs are HTTP that have not been indexed. However when i look at the Permalink it states HTTPS even though Google has this as HTTP.

How is this changed?


robot. txt File Editor Text

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Am i on the right track?

Thanks in advance.

Your robots.txt is fine and your htaccess file is redirecting all your http traffic to https.

RewriteRule ^(.*)$ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301,NE]

The above line in your htaccess is used to redirect http links to https. So, whenever you try to open http:// yourdomain.com, it'll redirect to https:// yourdomain.com

You're seeing the error because you're using old links in either your sitemap or internal links. You need to update all your http links to https to resolve the problem.

 

[Postie12345]

Your robots.txt is fine and your htaccess file is redirecting all your http traffic to https.

RewriteRule ^(.*)$ https://%{HTTP_HOST}%{REQUEST_URI} [L,R=301,NE]

The above line in your htaccess is used to redirect http links to https. So, whenever you try to open http:// yourdomain.com, it'll redirect to https:// yourdomain.com

You're seeing the error because you're using old links in either your sitemap or internal links. You need to update all your http links to https to resolve the problem.

Thanks, can you recommend any wordpress plugins that may do this that you know are of good quality.

 

[Starblazer]

Thanks, can you recommend any wordpress plugins that may do this that you know are of good quality.

Your sitemap will be automatically updated if you use any SEO plugin like Rankmath. Otherwise, you need to manually change links using any text editor like Notepad++. You can check the internal links using Ahrefs website audit tool. Here is a tutorial to replace internal links:
https://themify.me/blog/mass-replace-urls-https-wordpress-database

 

[miyuru2u]

Same happend to me and i also convert the Http links to https
Still wating for indexing

 

[Postie12345]

Your sitemap will be automatically updated if you use any SEO plugin like Rankmath. Otherwise, you need to manually change links using any text editor like Notepad++. You can check the internal links using Ahrefs website audit tool. Here is a tutorial to replace internal links:
https://themify.me/blog/mass-replace-urls-https-wordpress-database

Thank you

 

[Postie12345]

Same happend to me and i also convert the Http links to https
Still wating for indexing

Can i ask how you converted the Http links

 

[hideath]

Did you actually check if these pages are replaced by the HTTPs version in the SERPs,
GSC will not show the pages if you don't have the HTTPs version added in there as propriety, neither will show the traffic

 

[Postie12345]

Did you actually check if these pages are replaced by the HTTPs version in the SERPs,
GSC will not show the pages if you don't have the HTTPs version added in there as propriety, neither will show the traffic

Hi hideath, sorry for the late reply.

Yes i clicked on the Excluded HTTP GSC links which brought up the page in Https

 

[hideath]

Hi hideath, sorry for the late reply.

Yes i clicked on the Excluded HTTP GSC links which brought up the page in Https

add the domain to GSC by verifying by DNS or/and the HTTPs version and you can check the full traffic after a couple of days,
you're not losing the traffic, it's just not showing up within the current propriety of GSC

 

[Postie12345]

add the domain to GSC by verifying by DNS or/and the HTTPs version and you can check the full traffic after a couple of days,
you're not losing the traffic, it's just not showing up within the current propriety of GSC

Thanks, i added the code to the DNS a few days ago. Just logged in now so as you say i should know what the traffic is like in a couple of days.

 

[ANewBeginning]

Google Search Console has excluded over 90 pages on my Wordpress site which i need indexing again. My site was very well ranked in Google (Rank 1) for years but for some reason its now lost 70% visibility and the error comes up as (Pages With Redirect). i haven't changed anything in the site but it looks as though its been going on for 6 to 8 weeks now.

Can anyone help me sort this problem out

Sometimes google gives false-positives on the crawled tab. Just let google do its thing

 

[Postie12345]

Sometimes google gives false-positives on the crawled tab. Just let google do its thing

Thanks but it has really killed my Business, it needs to sort itself out quickly imho. I am more frustrated that my homepage was included in the 82 unindexed.