1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Too Many Crawler Errors at Google Webmaster - How to solve it?

Discussion in 'Black Hat SEO' started by dokasaf, May 22, 2011.

  1. dokasaf

    dokasaf Newbie

    Joined:
    Aug 28, 2009
    Messages:
    49
    Likes Received:
    13
    Hello all,

    My site have many Crawler Errors at google webmaster (more than 6000 "not found" errors). it happend couples of days after Google Panda Algorithm update. beacuse of the Errors my site is barely get traffic.

    There is something i can do in order to solve this issue?

    Thanks for the answers.
     
    Last edited: May 22, 2011
  2. mikie46

    mikie46 Jr. VIP Jr. VIP

    Joined:
    Aug 6, 2008
    Messages:
    1,454
    Likes Received:
    1,102
    Show us your robots.txt
    Tell us what type of site platform your using
     
  3. cyberzilla

    cyberzilla Elite Member Premium Member

    Joined:
    Nov 15, 2009
    Messages:
    2,204
    Likes Received:
    3,364
    Location:
    zeta reticuli
    Code:
    http://www.google.com/support/forum/p/Webmasters/thread?tid=56aa7dfac68937b1&hl=en
    Code:
    http://www.google.com/support/forum/p/Webmasters/thread?tid=3bdae920ea08cadd&hl=en
     
  4. dokasaf

    dokasaf Newbie

    Joined:
    Aug 28, 2009
    Messages:
    49
    Likes Received:
    13
    Hi this is my site robot.txt:
    User-agent: *
    Disallow: /cgi-bin/
    Disallow: /tmp/
     
    Last edited: May 22, 2011
  5. dokasaf

    dokasaf Newbie

    Joined:
    Aug 28, 2009
    Messages:
    49
    Likes Received:
    13
    Thanks but still it doesn't solve a thing.
     
  6. oliva999

    oliva999 Power Member

    Joined:
    Feb 6, 2010
    Messages:
    572
    Likes Received:
    69
    I am also interested - does it really affect traffic?
     
  7. mikie46

    mikie46 Jr. VIP Jr. VIP

    Joined:
    Aug 6, 2008
    Messages:
    1,454
    Likes Received:
    1,102
    You didnt answer question 2.

    The robots.txt looks fine if you want to include everything.

    What are the errors?
     
  8. dokasaf

    dokasaf Newbie

    Joined:
    Aug 28, 2009
    Messages:
    49
    Likes Received:
    13
    I will send you this at private.
     
    Last edited: May 22, 2011
  9. LBrown

    LBrown Senior Member

    Joined:
    Mar 22, 2011
    Messages:
    1,109
    Likes Received:
    1,827
    Occupation:
    Internet Marketer - Full Timer
    Location:
    The Land of the Brave
    I had the same problem for about a month on one of my sites. The crawl errors were something like mywidgetsite.com/tag/light-green-blue-widgets/tag/navy-blue-widgets-for-sale.

    Google was splicing my tag pages together and then telling me that they didn't exist. Well of course they don't exist! After a while, the message just went away. It didn't effect my traffic though.
     
  10. dokasaf

    dokasaf Newbie

    Joined:
    Aug 28, 2009
    Messages:
    49
    Likes Received:
    13
    6000 "not found" Errors are really effect traffic.