1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Googlebot crawling question

Discussion in 'Black Hat SEO' started by ryannull, Jun 11, 2012.

  1. ryannull

    ryannull Senior Member

    Joined:
    Feb 27, 2012
    Messages:
    805
    Likes Received:
    332
    Location:
    Zombieland, Florida
    Home Page:
    I have been noticing a random url in the middle of my crawl stamps.

    Code:
    [09/Jun/2012:08:41:56 -0400] "GET / HTTP/1.1" 200 9521  "http://randomurl.com/" "Mozilla/5.0 (compatible; Googlebot/2.1;  +http://www.google.com/bot.html)" 
    
    I have been seeing a lot of them, but not sure what it means.

    Does that mean Googlebot left that url and crawled mine after?

    I only need to know why I am seeing random urls in the crawling stats.
     
  2. ryannull

    ryannull Senior Member

    Joined:
    Feb 27, 2012
    Messages:
    805
    Likes Received:
    332
    Location:
    Zombieland, Florida
    Home Page:
    Come on, someone has to know the answer.
     
  3. ryannull

    ryannull Senior Member

    Joined:
    Feb 27, 2012
    Messages:
    805
    Likes Received:
    332
    Location:
    Zombieland, Florida
    Home Page:
    I guess, no one knows the answer.

    I see this all the time. I wish I knew what it meant.
     
  4. shatcore

    shatcore Registered Member

    Joined:
    Jan 10, 2012
    Messages:
    56
    Likes Received:
    15
    Referral perhaps..
     
  5. ryannull

    ryannull Senior Member

    Joined:
    Feb 27, 2012
    Messages:
    805
    Likes Received:
    332
    Location:
    Zombieland, Florida
    Home Page:
    That was what I was thinking, but I am not linked to those urls. At least, not by my doing.

    There is the possibility that there is a backlink and googlebot just uses the referral root.