Why doesn't Google index all of my articles?

cemsid

Regular Member
Joined
Sep 12, 2020
Messages
405
Reaction score
95
I have a website that is 3 years old. I add articles at regular intervals. However, Google insistently does not index some of my articles. There are 374 articles in the website content. Index of 316 of these articles. The rest are not indexed.
1698563133674.png



Screenshot 2023-10-29 110325.png
 
could be many reasons, really...

- the content of those articles is garbage
- 100% AI content

- crawl budget (google are having limited resources nowadays, and if they've already used them all up on other pages of your site you might need to wait until next month to get google to crawl - and index - these pages)

- orphaned pages (pages that have no links and no traffic coming into them are considered orphaned, therefore not valuable, therefore not worth indexing. Just throw some links - both internal and external - at those pages and re-submit sitemap to GSC... or request manual indexing of those links, although if they're full of AI / garbage content requesting indexing won't help much because they might get de-indexed days later... or wait for google to discover them on their own)

- time (google are very slow at indexing stuff nowadays, especially stuff that they don't consider important / quality, so those pages might never get indexed)
- technical issues (did you check whether those pages are not noindex'd? Because if they are noindex'd... well... good luck indexing them :) )

If the pages are not noindex'd you can share them on social media and other UGC sites (quora, reddit, imgur, etc) and / or throw them into a paid indexer and if they still don't index even after this much effort they're probably low quality and not worth google's attention
 
This is normal. It won't be 100% index. one of the reason might be insufficient crawling budget and google has a special algorithm to increase/decrease the budget base on your web performance/domain/rank/keyword and so on.
 
This could be even more hard, when Google not only doesn't index your articles, but also deindex some over the time. I would not focus entirely on what is not being indexed but what it's already indexing and what will be indexing in the future. I believe that with a massively growing number of pages on the internet, with the absurd amount of automations taking place nowadays, it's very difficult to analyze the causes of right indexation. From my point of view, reputation and authority, which mostly include, the quality of the incoming links, is one of the biggest factors, that make Google decide if your site is worthy to be fully indexed or not. Also the link distance from home, generally is another big factor (this doesn't mean that if you set a link from the nav menu to the site that is not indexing, it will index instantly, specially if your site has 0 reputation). Take into account all this elements to determine if your non-indexed pages are worth an extra effort or not.
 
There can be many reasons for pages not to get indexed,

The content is probably low quality, that's why Google is not indexing it
There is no link in your site pointing towards those posts, meaning your posts are hidden and Google doesn't think it's worth to index those
You are using AI-generated content
You are using spun content

There might be other reasons also
 
I have a website that is 3 years old. I add articles at regular intervals. However, Google insistently does not index some of my articles. There are 374 articles in the website content. Index of 316 of these articles. The rest are not indexed.
View attachment 294933


View attachment 294935
It could be due to issues like duplicate content or other kinds of problems; review and fix those issues, and try resubmitting your sitemap for better results.
 
What I am observing is that if you have a strong backlink profile towards your domain, indexing will be faster and consistent. So, work on backlinks.
 
Google may not be indexing all of your articles due to issues with the content, website structure, or other technical issues.
 
It might be a result of content issues or some other factors like algorithm updates. To troubleshoot you can use Google search console to check if your articles are listed as "not indexed" and see the provided reasons.
 
Did you try to index manually?
 
Hello cemsid,

If Google is not indexing some of your articles, there could be several reasons for this issue. Here are some factors that might be affecting the indexation of your articles:

1. Ensure that your articles provide high-quality, valuable content.
2. Check if your website has an XML sitemap that includes all the URLs of your articles.
3. Verify that your robots.txt file is not blocking Googlebot from accessing and crawling certain parts of your website, including articles that are not indexed.
4. Check Google Search Console for any crawl errors or issues that might be preventing Google from indexing your articles.
5. Ensure that your website is mobile-friendly, as Google considers mobile-first indexing.
 
I have a website that is 3 years old. I add articles at regular intervals. However, Google insistently does not index some of my articles. There are 374 articles in the website content. Index of 316 of these articles. The rest are not indexed.
You're churning out articles like a pro, but Google seems to be playing favorites – indexing some, while giving the cold shoulder to others.

Here's a couple of things you might wanna check out:

  1. Quality Check: Make sure the articles that aren't getting indexed are up to Google's standards. Sometimes, if Google thinks content isn't unique or valuable enough, it might pass on indexing it. It's like trying to get into a fancy club – you gotta dress to impress!
  2. Sitemap and Search Console: Double-check your sitemap is updated and submitted to Google Search Console. It's like giving Google a map to find all the cool stuff on your site.
  3. Manual Nudge: You can use Google Search Console to manually request indexing for those rogue articles. It's like tapping Google on the shoulder and saying, "Hey, you might've missed this."
  4. Review Site Structure: Make sure your site's navigation is easy and logical. Google likes it when it can find its way around without getting lost.
  5. Check for Noindex Tags: Sometimes, a sneaky little noindex tag finds its way into the HTML of a page. It tells Google to keep walking. Make sure none of your articles are accidentally telling Google to buzz off.
 
Back
Top