Wordpress SEO -- www.xx.com/feed

Kevin_Deng

Junior Member
Joined
Sep 29, 2021
Messages
105
Reaction score
34
I checked google search console, and found some urls of website were taged as "Crawled - currently not indexed",

many of them are "http://www.xx.com/post_name.html/feed",

it seems google don't index this kind of page,

My website is is Built with WordPress.

so do I need to Disallow these pages in robots.txt?

thanks.
 
Yes, it would be better to block crawling all of the feed pages,
You can also use some plugin to remove them entirely if they serve no purpose for you,
They can be used to easily copy your content as well, that's an additional point to consider
 
Yes, it would be better to block crawling all of the feed pages,
You can also use some plugin to remove them entirely if they serve no purpose for you,
They can be used to easily copy your content as well, that's an additional point to consider
Yes I do agree with @hideath it is better to remove these kind of feed pages they typically make no use for indexing.
 
I checked google search console, and found some urls of website were taged as "Crawled - currently not indexed",

many of them are "http://www.xx.com/post_name.html/feed",

it seems google don't index this kind of page,

My website is is Built with WordPress.

so do I need to Disallow these pages in robots.txt?

thanks.
Your situation is totally normal. Google doesn’t index these feed URLs because they’re not content-rich pages. They’re just a version of your posts meant for RSS readers, not something Google needs to rank.

So, yep. You need to disallow them in your robots.txt. This will prevent Google from crawling them in the future. It’s a way to tidy things up and help Google focus on the more important parts of your site, which are the actual blog posts or pages that you want to rank.
 
My approach is:

  • Block it in the robots.txt file
  • Use a plugin to block the generation of /feed (for WordPress websites)
  • Redirect /feed to none/feed

 
My approach is:

  • Block it in the robots.txt file
  • Use a plugin to block the generation of /feed (for WordPress websites)
  • Redirect /feed to none/feed

Can you explain how you block it in robots.txt and what plugin do you use to block the generation of /feed
 
Back
Top