1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Yes, Googlebot Understands Code...

Discussion in 'White Hat SEO' started by goawayplease, Jun 26, 2010.

  1. goawayplease

    goawayplease Regular Member

    Joined:
    Apr 10, 2008
    Messages:
    299
    Likes Received:
    67
  2. ultimategamechain

    ultimategamechain Power Member

    Joined:
    Apr 22, 2010
    Messages:
    527
    Likes Received:
    76
    Location:
    Here!
    Home Page:
    so its now ok even if our links is in javascript?
     
  3. trophaeum

    trophaeum Senior Member

    Joined:
    Dec 21, 2007
    Messages:
    1,189
    Likes Received:
    706
    theyv been doing this for a LONG time now to detect cloaking and malware, nothing new here
     
  4. ahmedbin91

    ahmedbin91 Newbie

    Joined:
    Jun 11, 2010
    Messages:
    16
    Likes Received:
    0
    I think there should be a great bot for making these google bot not inspect.
     
  5. trophaeum

    trophaeum Senior Member

    Joined:
    Dec 21, 2007
    Messages:
    1,189
    Likes Received:
    706
    if you get the code right they dont know but they have a LOT of heuristics they use to detect potential cloaking, lets just say most n00bs wont be able to cloak their site no matter what they do, iv managed to get cloaking working and not get banned but it always gets banned after enough time anyway
     
  6. goawayplease

    goawayplease Regular Member

    Joined:
    Apr 10, 2008
    Messages:
    299
    Likes Received:
    67
    That's the nature of heuristics... it's always learning and always improving. I found it interesting that they claim to respect POST based forms, but will attempt to crawl GET content whenever possible.

    Our resident SEO Analyst ipopbb tends to imply that Google doesn't call his external CSS or JS, so I wonder what the deal is with that... they can parse it, but how often DO they parse it?

     
  7. trophaeum

    trophaeum Senior Member

    Joined:
    Dec 21, 2007
    Messages:
    1,189
    Likes Received:
    706
    your analyst is wrong, google fetches them, just not as often, they tend to pick them up more often on suspicious quality links or low quality (read: grammatical errors/too high keyword density etc) content

    they also get them more often on brand new domains as a brand new domain is more likely to be an unknown quantity and may well be cloaking a lot more than an aged site would be
     
  8. minute80

    minute80 Regular Member

    Joined:
    Dec 3, 2008
    Messages:
    310
    Likes Received:
    81
    Bot does not interpret the whole JS code, since it would use too much CPU power. It just interprets certain portions of it to detect malware, redirects and similar as other in this thread have said, but it will avoid running any type of CPU intensive tasks.

    Regarding Flash, only recently ago did G entered a partnership with Adobe to support Flash better. The state now is that it can read into string variables embedded into swf's, but it will avoid complex functions too.
     
  9. bdtyrone

    bdtyrone Regular Member

    Joined:
    Nov 18, 2008
    Messages:
    216
    Likes Received:
    300
    This is just the start. Next Google will even index download-able file's size.
     
  10. hendricius

    hendricius Newbie

    Joined:
    Jun 26, 2010
    Messages:
    41
    Likes Received:
    2
    Occupation:
    Student and Entrepreneur
    Location:
    Hamburg, Germany
    Home Page:
    Web technologies are going forward and Google has to go with them... They also read links in PDF files etc...
     
  11. trophaeum

    trophaeum Senior Member

    Joined:
    Dec 21, 2007
    Messages:
    1,189
    Likes Received:
    706
    actually google can and does decode and run the js script entirely, i have had a bunch of sites with HUGE amounts of js as a test to try to stop goog reading it looking for redirects etc and its found them, it tries to avoid heavy cpu crunching, sure, but if its heurs detect something weird, they will spend the cpu time to check into it to ban you
     
  12. ipopbb

    ipopbb Power Member

    Joined:
    Feb 24, 2008
    Messages:
    626
    Likes Received:
    844
    Occupation:
    SEO & Innovative Programming
    Location:
    Seattle
    Home Page:
    I don't see this in my logs... Googlebot doesn't request my .js or my .css files...

    this is news to me... can you post a .js access googlebot User-Agent line for your logs? I'd love to know the version number thats running JS.