Google Search Console question

B

butlimous

Regular Member

Feb 6, 2008

347

72

• Aug 13, 2018

• #1

Hi,

I submitted to google search console a sitemap index that has around 8000 sitemaps. The total number of web pages in the sitemaps is 36+ million pages. For some reason, only 17 million pages are submitted as it appears in the console and no errors are displayed.

Both the new console and the old console show the same number.

 

terrycody

Elite Member

Sep 29, 2012

6,420

3,329

• Aug 13, 2018

• #2

butlimous said:

The total number of web pages in the sitemaps is 36+ million pages. For some reason, only 17 million pages are submitted

Click to expand...

I hope you are not kidding, how you can write those much contents?>!

 

B

butlimous

Regular Member

Feb 6, 2008

347

72

• Aug 13, 2018
• Thread Starter Thread Starter

• #3

It's auto-generated content but NOT spam. Content type similar to Alexa or SimilarWeb. Sort of collective stats on a topic with a very large number of available subtopics hence this number of URLs.

 

Vishal Sanjay

Power Member

Feb 9, 2017

655

147

• Aug 18, 2018

• #4

I think this has to do with crawl budgeting. Google assigns a certain crawl budget to each website to ensure that it doesn't overburden your resources or dampen user experience. If you don't see any errors or warnings, the remaining pages should get indexed over a period of time.

Frankly, I'm surprised that you got 17 million pages indexed.

 

B

butlimous

Regular Member

Feb 6, 2008

347

72

• Aug 18, 2018
• Thread Starter Thread Starter

• #5

Vishal Sanjay said:

I think this has to do with crawl budgeting. Google assigns a certain crawl budget to each website to ensure that it doesn't overburden your resources or dampen user experience. If you don't see any errors or warnings, the remaining pages should get indexed over a period of time.

Frankly, I'm surprised that you got 17 million pages indexed.

Click to expand...

The 17 million pages are just discovered from the sitemap. Still not crawled or indexed.

 

soniarunin

Regular Member

Jul 17, 2017

201

35

• Aug 19, 2018

• #6

Share the Google search console image...

 

BlackHatUSA

Newbie

Jul 19, 2018

16

9

• Aug 19, 2018

• #7

Do you have sitemap files larger than 10MB?

 

A

Akin Emmanuel

BANNED

May 31, 2018

54

6

• Aug 19, 2018

• #8

That's quite massive

 

iAuthority

Elite Member

Jr. VIP

Jan 20, 2013

9,383

1,012

• Aug 20, 2018

• #9

The number you have mentioned is huge, then how it will appear in the console soon? Wait for some time, still no effect then resubmit it.

 

emure

Newbie

Aug 10, 2018

46

32

• Jan 23, 2019

• #10

Hello

Probably this topic is too old, but if you need any help, just PM me, I have experience in big websites and submitting/generating big sitemaps.