Crawl frequency

Leyla_

Newbie
Joined
Dec 2, 2017
Messages
12
Reaction score
3
Hello,

I have created a new page on my website about 2 weeks ago. I have submitted it in GSC and it has been indexed but I notice that my page has not been crawled since (whereas lots of my pages are).
I have modified it and submitted it again. I don't understand why this page is less crawled than others. Do you have any idea?

I have added it in my menu, recently added my sitemap url in my robots.txt
Maybe I could also link it in my top articles. What do you advise me to do to make my page crawled more frequently?

Thanks a lot for helping!
 
But WHY? It's already indexed, so that's all you should care about :)
I am not ranking on the keyword I would like :) If my content is crawled more often, it is more likely to have a good position, right ?
 
NO! Crawling means that the googlebot (or whichever other bot is crawling your pages) simply "sees" the page and registers all of the content and links that are on that page, then jumps from link to link to discover more content and links (if available).

And the reason for which crawling is important for us, SEOers... or webmasters if you prefer, is to make google discover our content and links so they can get indexed in google's database. In other words, so we can be ranked in the SERPs (Search Engine Results Pages) in case that our content is good enough for google users to consume.

This is the only... well, the main anyway... purpose of having your pages crawled: to have your content indexed by google. But since your content is already indexed your job is finished (with regards to google noticing it I mean). You should only make google crawl the content that is not already indexed yet, because ideally, every webmaster will want 100% of the content that makes them money to be in the google index (database).

So, the content that's been indexed is already in google. All there's left for you to do now is make it rank (preferably on page 1 of google SERPs since that's where most of the traffic is, and preferably on position #1 since that's where most of the traffic is still, but top 3 will also work well). But... ranking in google is a whole another discussion in its own, and it's what everyone's fighting to death over to achieve, even though it's simple in nature: create quality content and get high quality backlinks (guest posts mostly, but quality PBN backlinks and web 2.0s also help, and equally important is getting backlinks from high authority websites like Reddit, NY Times, Forbes, Microsoft, or whatever... basically, websites that are so popular and have such a high authority that 3-4 backlinks from these websites will skyrocket your content to page 1 of google for a low-medium competition keyword without much effort. But getting quality backlinks from such websites is either difficult, costly, or both, which is why most beginner and / or poor SEOers / webmasters focus on web 2.0, guest post outreach, or cheap PBNs)

But anyway, I digress... the point is that crawling and indexing are different things, and as long as your content is indexed you shouldn't care about crawling anymore. Or, you should care about crawling the content that is not indexed yet and which you need to be indexed because it makes you money, but that's rarely up to you because you can't really control what the googlebot does.

So, don't stress about crawling, and focus on getting the content that's indexed rank on google's 1st page. That's when you will start getting traffic and - hopefully - money, too :)
 
The point op is making I think is that he updated the article enough that he should now be ranking for a new keyword?
and the new article hasn't been crawled yet again?

Not sure where you got that info from, but if your site is indexed, it will happen. Just a matter of time. Google is slow.
 
@Panther28 To me, the crawl rate of a page was a ranking factor. I was worried that my page is not crawled regularly.

Thanks to all of you for these answers :)
 
internal and external links along with some social media shares can make the trick
 
Back
Top