1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

What does this mean - "Crawl rate problem"

Discussion in 'BlackHat Lounge' started by epicurus, Jun 4, 2011.

  1. epicurus

    epicurus Registered Member

    Joined:
    May 10, 2011
    Messages:
    84
    Likes Received:
    11
    Hi

    For the past 4 days I have seen this message in my Google Webmaster Tools - "Crawl rate problem
    We were unable to download your Sitemap file at this time due to the crawl rate we're using for your server. This is likely a temporary issue, and we will try to download the file again in the near future"

    I have checked my sitemap and its there. I have recreated it and re-submitted it.. still no joy.

    Should this be something I need to worry about

    Cheers

    JS
     
  2. Autumn

    Autumn Elite Member

    Joined:
    Nov 18, 2010
    Messages:
    2,197
    Likes Received:
    3,041
    Occupation:
    I figure out ways to make money online and then au
    Location:
    Spamville
  3. epicurus

    epicurus Registered Member

    Joined:
    May 10, 2011
    Messages:
    84
    Likes Received:
    11
    Cheers for the info. Not played with the crawler rate but have just made a small adjustment to see who that works.