Very Low Crawl Rate

Discussion in 'White Hat SEO' started by incomescout, Mar 21, 2017.

  1. incomescout

    incomescout Registered Member

    Joined:
    Mar 11, 2017
    Messages:
    57
    Likes Received:
    20
    Gender:
    Male
    I have a 120-page site that only gets about 10 page crawls a day.

    That feels kinda low.

    Anyone have experience in this area?

    Thanks!
     
  2. Samwacgamchy

    Samwacgamchy Jr. VIP Jr. VIP

    Joined:
    Jan 11, 2017
    Messages:
    266
    Likes Received:
    56
    Gender:
    Female
    Is it a new website? New websites aren't crawled that much because then people would start abusing that. The only think that can help you is a lot of backlinks. That way bots get referred a lot to your website through backlinks and then your crawl rate will improve.
     
    • Thanks Thanks x 1
  3. Ding Dong

    Ding Dong Jr. VIP Jr. VIP

    Joined:
    Feb 8, 2015
    Messages:
    1,485
    Likes Received:
    416
    Gender:
    Male
    Occupation:
    SEO expert
    Create backlinks
    share your contents on the social media network
    update your content frequently then use Fetch as Google option
    check what crawl rate setting you have done on search console
    Check whether you have done your internal linking proper or not, use silo structure
     
  4. stack paper

    stack paper Jr. VIP Jr. VIP

    Joined:
    Jan 24, 2008
    Messages:
    668
    Likes Received:
    374
    Occupation:
    Analog Nomad
    Location:
    Reddit / Chiang Mai
    Home Page:
  5. zentek

    zentek Newbie

    Joined:
    Jun 23, 2014
    Messages:
    26
    Likes Received:
    4
    1: Submit your sitemap on Google
    2: Use cache plugin
    3: submit your site on alltop.com
    4: create few good backlinks to make your domain powerful

    That's it.

    It's helping me for fast indexing.
     
  6. incomescout

    incomescout Registered Member

    Joined:
    Mar 11, 2017
    Messages:
    57
    Likes Received:
    20
    Gender:
    Male
    Very helpful everyone thanks! Gonna give your tips a try :)
     
  7. shakthipriya

    shakthipriya BANNED BANNED

    Joined:
    Mar 1, 2017
    Messages:
    39
    Likes Received:
    9
    Gender:
    Female
    10 ways to crawl your rate very low:
    1)Update your site Content Regularly
    2)Server with Good Uptime
    3)Create Sitemaps
    4)Avoid Duplicate Content
    5)Reduce your site Loading Time
    6)Block access to unwanted page via Robots.txt
    7)Monitor and Optimize Google Crawl Rate
    8)Use Ping services:
    9)Interlink your blog pages like a pro:
    10)Don’t forget to Optimize Images
     
  8. Aiden_1

    Aiden_1 Jr. VIP Jr. VIP

    Joined:
    Jun 25, 2015
    Messages:
    1,371
    Likes Received:
    232
    Gender:
    Male
    Occupation:
    SEO - Freelancer
    Home Page:
    Maybe post your links randomly in social media with useful articles will have the chance to index soon.
     
  9. stevesolo

    stevesolo Senior Member

    Joined:
    Jul 3, 2014
    Messages:
    926
    Likes Received:
    262
    Gender:
    Female
    Occupation:
    Content Marketing
    Location:
    BHW Boat
    Home Page:
    The tips to get your site crawled more often is quite simple, build quality backlinks to your site and share it on Google+, and on other social media networks as well.
     
  10. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    13,972
    Likes Received:
    12,494
    Occupation:
    MACHIN LURNIN
    Location:
    TUVALU
    Home Page:
    Go into GWT and "crawl as google". You can request 120 crawls easily. New sites gotta suffer you know.
     
  11. gary2

    gary2 Jr. VIP Jr. VIP

    Joined:
    Jan 20, 2013
    Messages:
    1,734
    Likes Received:
    236
    Occupation:
    Inbound Marketer. Blogger. Author.
    Location:
    Near River
    You can make unique content and update your content frequently and then Share it on social media helps to increase crawl rate of your website.
     
  12. ZachMiller

    ZachMiller Jr. VIP Jr. VIP

    Joined:
    Oct 6, 2016
    Messages:
    206
    Likes Received:
    54
    Gender:
    Male
    Occupation:
    Email & Sales Funnel Consultant
    Location:
    Atlanta, GA
    Home Page:
    If it's a new site.. this is normal..

    Build links to improve this.. not gonna be instant though!
     
  13. iAuthority

    iAuthority Jr. VIP Jr. VIP

    Joined:
    Jan 20, 2013
    Messages:
    2,439
    Likes Received:
    311
    Gender:
    Male
    Occupation:
    SEO,Link Building,Blogging.
    Home Page:
    It is a similar issue on new sites, use unique and user engaging content to get it crawled soon.Use the GWT to crawl the links, but don't use it often.
     
  14. Aamir630

    Aamir630 Newbie

    Joined:
    May 3, 2017
    Messages:
    24
    Likes Received:
    3
    Gender:
    Male
    I doubt your content is not that good, which is backing up Google to crawl your site more often.Though more content is good way to increase Google crawl there are other ways tohttp://johnnybaskin.com/what-is-google-crawler/increase the crawl rate and I think you should try applying other tricks also
     
  15. soccerlover

    soccerlover Moderator-In-Training Jr. VIP

    Joined:
    Jun 12, 2014
    Messages:
    3,708
    Likes Received:
    1,989
    Gender:
    Male
    Occupation:
    Managing BHW :D
    Location:
    ♥♥♥ BHW ♥♥♥
    Home Page:
    Either share on social media or use GWT to fetch & render.

    It will definitely help ya!
     
  16. COSMO:PROXY

    COSMO:PROXY Junior Member

    Joined:
    Nov 9, 2017
    Messages:
    113
    Likes Received:
    13
    Location:
    US
    thanks for answers. these helps me too!
     
  17. Lightproxies

    Lightproxies Jr. VIP Jr. VIP

    Joined:
    Aug 14, 2017
    Messages:
    372
    Likes Received:
    79
    Gender:
    Male
    I think maybe there isn't just that as many activity on your site. If your content remains the same, or if user interaction is low, then with the same content available, the spiders would just be rescheduled for another crawl sometime later, but not too soon.
    If you are able to consistently put content, and increase the user interaction, such as letting the users browse more pages on your site, or have communication directly on your page, and with all these fresh content, the spiders would definitely be attracted to these.
    So with the above addressed, you can start to build quality links to your site, those that aren't spammy but good ones, and with better authority from those links, your site will enjoy better crawl rate after that.
     
  18. don chino

    don chino Jr. VIP Jr. VIP UnGagged Attendee

    Joined:
    Apr 2, 2011
    Messages:
    887
    Likes Received:
    283
    Occupation:
    PBN creator / seller
    Location:
    Europe
    Home Page:
    Low crawling means low activity, which can be cured with backlinks, traffic, social presence... usually the more traffic and attention a site gets the more crawling, too. Add your site in GWT you will get more details about it if you haven't done it yet.