Google Search Console question

[butlimous]

Hi,

I submitted to google search console a sitemap index that has around 8000 sitemaps. The total number of web pages in the sitemaps is 36+ million pages. For some reason, only 17 million pages are submitted as it appears in the console and no errors are displayed.

Both the new console and the old console show the same number.

 

[terrycody]

The total number of web pages in the sitemaps is 36+ million pages. For some reason, only 17 million pages are submitted

I hope you are not kidding, how you can write those much contents?>!

 

[butlimous]

It's auto-generated content but NOT spam. Content type similar to Alexa or SimilarWeb. Sort of collective stats on a topic with a very large number of available subtopics hence this number of URLs.

 

[Vishal Sanjay]

I think this has to do with crawl budgeting. Google assigns a certain crawl budget to each website to ensure that it doesn't overburden your resources or dampen user experience. If you don't see any errors or warnings, the remaining pages should get indexed over a period of time.

Frankly, I'm surprised that you got 17 million pages indexed.

 

[butlimous]

I think this has to do with crawl budgeting. Google assigns a certain crawl budget to each website to ensure that it doesn't overburden your resources or dampen user experience. If you don't see any errors or warnings, the remaining pages should get indexed over a period of time.

Frankly, I'm surprised that you got 17 million pages indexed.

The 17 million pages are just discovered from the sitemap. Still not crawled or indexed.

 

[soniarunin]

Share the Google search console image...

 

[BlackHatUSA]

Do you have sitemap files larger than 10MB?

 

[Akin Emmanuel]

That's quite massive

 

[iAuthority]

The number you have mentioned is huge, then how it will appear in the console soon? Wait for some time, still no effect then resubmit it.

 

[emure]

Hello

Probably this topic is too old, but if you need any help, just PM me, I have experience in big websites and submitting/generating big sitemaps.