Very Low Crawl Rate

incomescout

incomescout

Registered Member
Joined
Mar 11, 2017
Messages
57
Reaction score
20
I have a 120-page site that only gets about 10 page crawls a day.

That feels kinda low.

Anyone have experience in this area?

Thanks!
 
Advertise on BHW
Is it a new website? New websites aren't crawled that much because then people would start abusing that. The only think that can help you is a lot of backlinks. That way bots get referred a lot to your website through backlinks and then your crawl rate will improve.
 
Create backlinks
share your contents on the social media network
update your content frequently then use Fetch as Google option
check what crawl rate setting you have done on search console
Check whether you have done your internal linking proper or not, use silo structure
 
Make sure your sitemap is dialed in and check crawl rate in WMT. Then keep adding content / building links & social signals.
 
1: Submit your sitemap on Google
2: Use cache plugin
3: submit your site on alltop.com
4: create few good backlinks to make your domain powerful

That's it.

It's helping me for fast indexing.
 
Very helpful everyone thanks! Gonna give your tips a try :)
 
10 ways to crawl your rate very low:
1)Update your site Content Regularly
2)Server with Good Uptime
3)Create Sitemaps
4)Avoid Duplicate Content
5)Reduce your site Loading Time
6)Block access to unwanted page via Robots.txt
7)Monitor and Optimize Google Crawl Rate
8)Use Ping services:
9)Interlink your blog pages like a pro:
10)Don’t forget to Optimize Images
 
The tips to get your site crawled more often is quite simple, build quality backlinks to your site and share it on Google+, and on other social media networks as well.
 
Go into GWT and "crawl as google". You can request 120 crawls easily. New sites gotta suffer you know.
 
If it's a new site.. this is normal..

Build links to improve this.. not gonna be instant though!
 
It is a similar issue on new sites, use unique and user engaging content to get it crawled soon.Use the GWT to crawl the links, but don't use it often.
 
incomescout said:
I have a 120-page site that only gets about 10 page crawls a day.

That feels kinda low.

Anyone have experience in this area?

Thanks!
Click to expand...
I doubt your content is not that good, which is backing up Google to crawl your site more often.Though more content is good way to increase Google crawl there are other ways tohttp://johnnybaskin.com/what-is-google-crawler/increase the crawl rate and I think you should try applying other tricks also
 
Either share on social media or use GWT to fetch & render.

It will definitely help ya!
 
I think maybe there isn't just that as many activity on your site. If your content remains the same, or if user interaction is low, then with the same content available, the spiders would just be rescheduled for another crawl sometime later, but not too soon.
If you are able to consistently put content, and increase the user interaction, such as letting the users browse more pages on your site, or have communication directly on your page, and with all these fresh content, the spiders would definitely be attracted to these.
So with the above addressed, you can start to build quality links to your site, those that aren't spammy but good ones, and with better authority from those links, your site will enjoy better crawl rate after that.
 
Low crawling means low activity, which can be cured with backlinks, traffic, social presence... usually the more traffic and attention a site gets the more crawling, too. Add your site in GWT you will get more details about it if you haven't done it yet.
 
Advertise on BHW
You must log in or register to reply here.
Sign up now!

Main Menu

Home Main Forum List Black Hat SEO White Hat SEO BHW Newbie Guide Blogging Black Hat Tools Social Media Downloads

Marketplace

Account Selling Content / Copywriting EBooks / Methods Hosting Misc Proxies For Sale SEO - Link building SEO - Packages Social Media Social Media - Panels Web Design More

Making Money

Affiliate Programs Hire a Freelancer IM Journeys Making Money Pay Per Click Site Flipping Want to Buy

BlackHat World

Dispute Resolution Forum Suggestions & Feedback Introductions Lounge
Back
Top