Google is not indexing my free products - WHY???

obabo

Junior Member
Joined
Mar 4, 2023
Messages
125
Reaction score
60
Hey everyone,

I have been cross with this problem for over a month and couldn't find a solution anywhere.

I have a website to sell my digital products and one of the sections is a free product,
like a little snippet of the entire digital product just to the visitors have an idea about the material and if they like they can buy the full product.

After a lot of struggle with woocommerce :mad: and the noindex drama that took me a week to figure out how to solve :confused:, my entire page is finally indexed on google...

Or should I though tho... o_O


Fixing XML, not working for a couple of weeks, indexing one by one, I realized that Google is indexing none of the pages that have a free product,
doesn't matter if I send it multiple times, wait a week and all the shenanigans...
Looks like never ever been requested in the first place.

And that is the strange part: all the full products are indexed with no problems

I checked the code, the robot is okay, index and all the things;
I mean if noindex will show up on the problems found by Google, but not only is all correct, not even a problem showed up...
Literally looks like I never send it.

Is anyone with any idea why this happening ?

have a great day
 
Cant help you if you dont show us the site?

Couldn't be a number of things, like a poor-quality site that doesn't gain trust from google.
 
Cant help you if you dont show us the site?

Couldn't be a number of things, like a poor-quality site that doesn't gain trust from google.
Sure, no problem!

My website is https://iprof.shop/

One example of this problem:

This is the free Master of ABCs, I had requested Google to index it more than 5 times, just go back to what I never ever sent it to them!


https://iprof.shop/index.php/product/free-master-of-abcs-fruits/
Screen Shot 2023-06-29 at 8.54.45.png
 
how long this url?
its a about 1 month like others url that indexed on your page?
maybe you can try using link indexing service
 
how long this url?
its a about 1 month like others url that indexed on your page?
maybe you can try using link indexing service
Long you mean characters, right? I have some free products with shorter links than some paid indexed ones, so I don't really believe that is the problem.
About the time, I would be honest, is bloody confused cuz many links had been indexed in the last week which is great, however, the free product, instead to say they are in index processing, like the other page, simply show as I never send it

Screen Shot 2023-06-29 at 8.54.45.png


My only two ideas are: or google has a problem with the word "free" for some reason, or some problem with the easy download plugin, but I couldn't find anything pointing in this direction.

Have you ever experienced discrepancy indexation times?
Which indexation services do you know about you can refer to me?
 
its not that long url, i have some that break from serp and still have a good indexed too.
hmm.. thats pretty weird if so, i think if the other link on your site indexed for 1 weeks but this free service not indexed you may check on the settings, like its follow link? its proper seo meta link?

on my opinion google doesnt have that rules for evading the "free" or easy download.

i cant provide that here, but you can try on the forum marketplace, actually you may check this thread since they provide a free reviews for the service
 
its not that long url, i have some that break from serp and still have a good indexed too.
hmm.. thats pretty weird if so, i think if the other link on your site indexed for 1 weeks but this free service not indexed you may check on the settings, like its follow link? its proper seo meta link?

on my opinion google doesnt have that rules for evading the "free" or easy download.

i cant provide that here, but you can try on the forum marketplace, actually you may check this thread since they provide a free reviews for the service
Yeah true
I suspected the robots (again) but no, it's fine.
Screen Shot 2023-06-29 at 10.09.12.png


I thought was the problem with the "free" word or download because I had a very annoying problem with meta business: When I tried to add my free download, they blocked it because neither free nor digital materials were allowed.

So I believe Google Index had this same but as shadowbanned words.
About the SEO meta link, I believe is fine, after many problems with Yoast, but I'm not sure.
 
all good for the index, and metas.
hmm do you have try check on ahref report, to that specific pages/post?

thats new for me if so about the "free". maybe some expert will show here, hope can help you out this prob.
 
You need to take care of the
Code:
index.php
part in your url.
Add a nginx rewrite to handle this.
 
You need to take care of the
Code:
index.php
part in your url.
Add a nginx rewrite to handle this.
Sorry, I'm not that super expert, could you please explain what do you mean by this code?
thank you
 
I see you checked your meta robot setting but have you verified that your robots.txt file allows crawling on those pages?
sure
the robots were made by Yoast, and doesn't look like this page is disallowed.
is it any other place I can look for?
 
sure
the robots were made by Yoast, and doesn't look like this page is disallowed.
is it any other place I can look for?
on .htacess about something that blocking your url, or crawling setup
 
looking more into it, google has omitted 26 of your pages from my search on your domain name. only showing me about 26 of them and saying they have about 116 results. 33 of your pages are indexed it looks like.

looks like the 26 they omitted are archived pages. aka duplicate content.

I would suggest cleaning up the duplicate content, checking all pages to see how close the content on each. And changing the pages with the duplications.

This page might not be being indexed, because its to close to the "non free" course.

you might have also reached your indexing ratio...

Knowing the number of pages indexed from our sitemap, we’ll compare that to all the pages Google has indexed from our site. Expand the ‘Google Index’ option in the side menu and select ‘Index Status.’ Divide the pages indexed from our sitemap by Google’s total index of our site. I call that the Index Ratio.

This section was written with Authority Forge 2.0

How to Fix Google Indexing Issues for Your Website


This guide will help you address and resolve three common Google indexing issues for your website:

  1. 1. Your entire website isn’t indexed.
  2. 2. Only some pages are indexed, while others are not.
  3. 3. Newly published web pages are not getting indexed fast enough.

Before we delve into the solutions for these problems, let's ensure we have a clear understanding of crawling and indexing.

What is crawling and indexing?


Google discovers new web pages through a process called crawling, which involves following hyperlinks on the web to discover new content. Once discovered, these pages are added to Google's index—a vast database of web pages. Google uses a web spider called Googlebot to carry out the crawling process.

Now let's address each indexing issue.

---

1) Your entire website isn't indexed


To check if your entire website is indexed by Google:
Go to Google and search for "site:yourwebsite.com." The number of results displayed will give you an approximate idea of how many of your website's pages are indexed.

If none of your web pages are indexed, it indicates a significant problem. To address this issue:

- Sign up for Google Search Console (it's free) and use the Coverage report to get accurate insights into the index status of your website.
- Ensure there are no crawl blocks in your robots.txt file. Check if the

User-agent: Googlebot
Disallow: /
User-agent: *
Disallow: /

code is present in your robots.txt file and remove it if necessary.

- If a page is not indexed, check if it is blocked by robots.txt using the URL inspection tool in Search Console. If so, recheck your robots.txt file for any disallow rules related to that page or its subsections and remove them.

---

2) Some pages are indexed while others are not


If only certain pages of your website are indexed, while others are not, follow these steps:

- Verify that these pages are not blocked by crawl blocks in robots.txt. Check for the presence of the code mentioned above and remove it if necessary.
- Ensure there are no rogue no index tags. Pages with the meta tags <meta name="robots" content="noindex"> or <meta name="googlebot" content="noindex"> will not be indexed by Google. Use a tool like Ahrefs' Site Audit to identify pages with these tags and remove them if they don't belong.
- Ensure that these pages are included in your sitemap. Check the URL inspection tool in Search Console for the "URL is not on Google" error and "Sitemap: N/A" message. If you haven't included those pages in your sitemap, add them and let Google know by pinging their URLs using http://www.google.com/ping?sitemap=http://yourwebsite.com/sitemap_url.xml.

---

3) Newly published web pages aren’t getting indexed fast enough


If your newly published web pages take too long to get indexed, try the following:

- Use the URL inspection tool in Google Search Console to request indexing for specific URLs. This informs Google that you have added new content to your website and prompts them to crawl and index it.
- Add internal links from authoritative pages on your website to the new web page you want to index. This helps Google discover and prioritize crawling those pages faster.
- Ensure that the new page provides unique, valuable content for users. If it lacks value or duplicates existing content, Google may choose not to index it.
- Remove any low-quality pages from your website as they waste crawl budget and delay indexing of more valuable content.
- Consider building high-quality backlinks to your web pages. Backlinks signal to Google that a page is important and prompt faster indexing.

---

Remember, getting your website or web page indexed by Google does not guarantee rankings or traffic. Indexing simply means that Google is aware of your website or page. To improve your chances of ranking high in search results, you need to optimize your pages with SEO strategies.

If you follow the steps outlined in this guide, you will be well on your way to resolving Google indexing issues and improving your website's visibility.
 
Last edited:
looking more into it, google has omitted 26 of your pages from my search on your domain name. only showing me about 26 of them and saying they have about 116 results. 33 of your pages are indexed it looks like.

looks like the 26 they omitted are archived pages. aka duplicate content.

I would suggest cleaning up the duplicate content, checking all pages to see how close the content on each. And changing the pages with the duplications.

This page might not be being indexed, because its to close to the "non free" course.

you might have also reached your indexing ratio...

Knowing the number of pages indexed from our sitemap, we’ll compare that to all the pages Google has indexed from our site. Expand the ‘Google Index’ option in the side menu and select ‘Index Status.’ Divide the pages indexed from our sitemap by Google’s total index of our site. I call that the Index Ratio.

This section was written with Authority Forge 2.0

How to Fix Google Indexing Issues for Your Website


This guide will help you address and resolve three common Google indexing issues for your website:

  1. 1. Your entire website isn’t indexed.
  2. 2. Only some pages are indexed, while others are not.
  3. 3. Newly published web pages are not getting indexed fast enough.

Before we delve into the solutions for these problems, let's ensure we have a clear understanding of crawling and indexing.

What is crawling and indexing?


Google discovers new web pages through a process called crawling, which involves following hyperlinks on the web to discover new content. Once discovered, these pages are added to Google's index—a vast database of web pages. Google uses a web spider called Googlebot to carry out the crawling process.

Now let's address each indexing issue.

---

1) Your entire website isn't indexed


To check if your entire website is indexed by Google:
Go to Google and search for "site:yourwebsite.com." The number of results displayed will give you an approximate idea of how many of your website's pages are indexed.

If none of your web pages are indexed, it indicates a significant problem. To address this issue:

- Sign up for Google Search Console (it's free) and use the Coverage report to get accurate insights into the index status of your website.
- Ensure there are no crawl blocks in your robots.txt file. Check if the

User-agent: Googlebot
Disallow: /
User-agent: *
Disallow: /

code is present in your robots.txt file and remove it if necessary.

- If a page is not indexed, check if it is blocked by robots.txt using the URL inspection tool in Search Console. If so, recheck your robots.txt file for any disallow rules related to that page or its subsections and remove them.

---

2) Some pages are indexed while others are not


If only certain pages of your website are indexed, while others are not, follow these steps:

- Verify that these pages are not blocked by crawl blocks in robots.txt. Check for the presence of the code mentioned above and remove it if necessary.
- Ensure there are no rogue no index tags. Pages with the meta tags <meta name="robots" content="noindex"> or <meta name="googlebot" content="noindex"> will not be indexed by Google. Use a tool like Ahrefs' Site Audit to identify pages with these tags and remove them if they don't belong.
- Ensure that these pages are included in your sitemap. Check the URL inspection tool in Search Console for the "URL is not on Google" error and "Sitemap: N/A" message. If you haven't included those pages in your sitemap, add them and let Google know by pinging their URLs using http://www.google.com/ping?sitemap=http://yourwebsite.com/sitemap_url.xml.

---

3) Newly published web pages aren’t getting indexed fast enough


If your newly published web pages take too long to get indexed, try the following:

- Use the URL inspection tool in Google Search Console to request indexing for specific URLs. This informs Google that you have added new content to your website and prompts them to crawl and index it.
- Add internal links from authoritative pages on your website to the new web page you want to index. This helps Google discover and prioritize crawling those pages faster.
- Ensure that the new page provides unique, valuable content for users. If it lacks value or duplicates existing content, Google may choose not to index it.
- Remove any low-quality pages from your website as they waste crawl budget and delay indexing of more valuable content.
- Consider building high-quality backlinks to your web pages. Backlinks signal to Google that a page is important and prompt faster indexing.

---

Remember, getting your website or web page indexed by Google does not guarantee rankings or traffic. Indexing simply means that Google is aware of your website or page. To improve your chances of ranking high in search results, you need to optimize your pages with SEO strategies.

If you follow the steps outlined in this guide, you will be well on your way to resolving Google indexing issues and improving your website's visibility.
WOW... amazing
I will check them one by one!
 
Get A links from News Site (Old Edition) it will work well

IT will get indexed fast
 
your site is indexed. if you want individual pages to get indexed then put a large body of unique content on them (. i.e. chatgpt maybe), link to them from your homepage and from other sites, and then drink a nice tall glass of some sweetened iced tea.
 
you need more content on your pages, also as suggested by another member here... try to get some backlinks
 
your site is indexed. if you want individual pages to get indexed then put a large body of unique content on them (. i.e. chatgpt maybe), link to them from your homepage and from other sites, and then drink a nice tall glass of some sweetened iced tea.
Yeah my main page id index but I want the free digital products to be index too
that's is the problem.

anyways thanks
 
Back
Top