Large sitemap file

[s7742777]

Hi guys, I really need some suggestions for this.
I have a new real estate website with a few million listings.

What's the best way to create and submit the sitemap for my site? I know that I need to limit the number of URLs to 50,000 in each sitemap and gzip it. But my question is

a. Do I make all the sitemap index files and ALL the sitemaps (with 50K URLs each) and submit millions of links to Google then hope for the best?
OR
b. Split my sitemap files to about 500-1000 urls then submit to Google incrementally over a period of a few months or longer.

c. make all the sitemap index files and ALL the sitemaps (with 50K URLs each) and NOT submit to Google at all. Just refer to it from the robots.txt and monitor search console?

Any input with rationale would help. Thanks in advance guys.

 

[Evander]

A number of plugins let you sort a sitemap by month. That's the way to go, in my opinion.

I have never seen a sitemap with 50k links. Maybe that won't sit well with Google.

 

[s7742777]

A number of plugins let you sort a sitemap by month. That's the way to go, in my opinion.

I have never seen a sitemap with 50k links. Maybe that won't sit well with Google.

Thanks for helping. That's exactly why I'm asking before I create them. I've looked deeply into zillow and realtor.com's sitemaps. That's how they have them structured, 50K links in each gzipped sitemap with a sitemap index that lists all of them. But those websites have been around since robots.txt was invented.

My issue is whether to submit everything at the same time, or incrementally. And whether to submit at all? Should I just rely on robots.txt? That way we seem a lot less spammy to google because we're being passive.

 

[afyie]

facing similar issues with a client with enormous amount of web pages

 

[s7742777]

facing similar issues with a client with enormous amount of web pages

Can you share your findings? Did you deploy your sitemap? Any issues?

 

[Dhavaljain]

Hello, I am having the same question, As my website has user-generated pages and has 4 Different categories.
What is the best way to create a sitemap with proper indexing?

 

[sam.hunt0710]

Solution for this making sitemap.xml as per the category and then adding those to parent sitemap.

Each sitemap can have 50K Url's or size of the file should be 50 MB.

So main sitemap will be domainname.com/sitemap.xml , inside this you can add

domainname.com/sitemap1.xml
domainname.com/sitemap2.xml
domainname.com/sitemap3.xml
domainname.com/sitemap4.xml

More details you can get from here

For an example yellowpages

 

[Dhavaljain]

Solution for this making sitemap.xml as per the category and then adding those to parent sitemap.

Each sitemap can have 50K Url's or size of the file should be 50 MB.

So main sitemap will be domainname.com/sitemap.xml , inside this you can add

domainname.com/sitemap1.xml
domainname.com/sitemap2.xml
domainname.com/sitemap3.xml
domainname.com/sitemap4.xml

More details you can get from https://developers.google.com/search/docs/advanced/sitemaps/large-sitemaps

For an example https://www.yellowpages.ca/sitemap.xml

Hello,

Thanks but i have a query, but is the GZ file good for search engine bots?

Andi saw one news site's sitemap which is look like below,

<![CDATA[ https://www.aajtak.in/auto ]]>

What is the mean and use?

 

[sam.hunt0710]

Please check this

Stackoverflow

Wikipedia

Hope these links will work