Googlebot - New and improved crawl stats for your site

MisterF

Repeat Selling Out MP - Doxxing - Harass Comps.
Joined
Nov 29, 2009
Messages
28,936
Reaction score
43,777
To help website owners better understand how Googlebot crawls their sites, we’re launching a brand new version of the Crawl stats report in Search Console.


Code:
https://developers.google.com/search/blog/2020/11/search-console-crawl-stats-report.html
 
Wow for people like me with big (pages) websites this is awesome
 
To help website owners better understand how Googlebot crawls their sites, we’re launching a brand new version of the Crawl stats report in Search Console.


Code:
https://developers.google.com/search/blog/2020/11/search-console-crawl-stats-report.html

Interesting. I'm starting to learn about SEO and everything. Why does it matter to know what links Google crawls?

file type of the fetched URL, purpose of the crawl request, and Googlebot agent
 
Fixing crawing was a better idea.
But I agree... there's no crawling problem... it's just google wants to crawl what it wants.
So... being equal... small or big site... crawl the same... sounds fair enough.

At times google all over my website, at times I can't invite the google bot to come to it. So much for the fair load... at times they are just killing my site with their crawls.
 
If this will crawl better and faster then it's good news for all.
 
Back
Top