1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Help! Losing 100 bucks a day crawling problems

Discussion in 'Hire a Freelancer' started by eforestal55, Dec 28, 2009.

  1. eforestal55

    eforestal55 Registered Member

    Joined:
    Oct 21, 2009
    Messages:
    96
    Likes Received:
    1
    I hope someone can help me I'm losing cash out of my behind. Okay I haven't done any major changes to my site and sudenly google stopped crawling my site. I submitted a sitemap and this is the error I get. the problem is I don't have a robot.txt file so I don't know how they are finding it. here's the error message below:

    Network unreachable: robots.txt unreachable
    We were unable to crawl your Sitemap because we found a robots.txt file at the root of your site but were unable to download it. Please ensure that it is accessible or remove it completely.
     
  2. Peter Shaw

    Peter Shaw BANNED BANNED

    Joined:
    Sep 1, 2009
    Messages:
    902
    Likes Received:
    359
    If you don't have a robots.txt file, how did it work before the problem?
     
  3. Seoff

    Seoff Newbie

    Joined:
    Jun 4, 2009
    Messages:
    16
    Likes Received:
    19
    I might be able to help you, I had a similar problem a month ago, check your PM
     
  4. rnc505

    rnc505 Regular Member

    Joined:
    Oct 28, 2008
    Messages:
    229
    Likes Received:
    109
    maybe your permissions aren't enabled enough.

    Since it is a relatively safe file give it 777 permissions and try again.
     
  5. eforestal55

    eforestal55 Registered Member

    Joined:
    Oct 21, 2009
    Messages:
    96
    Likes Received:
    1
    well I don't remember creating a robots.txt. I thought the purpose of a robots.txt file is to keep bots from indexing certain pages on your site. If this is true, I never created one. Maybe I need to create one, I don't know what to do. Can someone pm me and tell me what to do to get this problem fixed. I'm losing sales badly..

     
  6. alexaassassin

    alexaassassin Registered Member

    Joined:
    Feb 9, 2009
    Messages:
    97
    Likes Received:
    255
    Either A:
    your privacy setting may be set to block search engines

    or B:

    Your robots.txt file is corrupt or set to disallow something other than *

    or C:
    "I haven't done any major changes to my site and sudenly google stopped crawling my site."


    WRONG! You just THINK your changes were not major!

    What DID you change since it last worked?
    Theme? New plugin, maybe?
     
    Last edited: Dec 28, 2009