PHP Script to Detect Googlebot

[Autumn]

I think that page is big bullshit in fact. What are those "800" bots? Shoudl i also code my 800 bots and start taking money from stupid users and provide similar service? No thanks.

If you don't know who Fantomaster is then you haven't been around for very long and can't really call yourself a blackhat. It's as simple as that. The man has been a legend in the blackhat community since the late 90s.

I'm not going to argue with you about this because, like I said, I have no stake in this - I'm just pointing out the most robust solution to the other readers.

 

[NIXMY]

If you don't know who Fantomaster is then you haven't been around for very long and can't really call yourself a blackhat. It's as simple as that. The man has been a legend in the blackhat community since the late 90s.

I'm not going to argue with you about this because, like I said, I have no stake in this - I'm just pointing out the most robust solution to the other readers.

Did i called myself a blackhat? I don't think so. Well maybe that guy's system is legit but im not gonna try it out.

I've managed to get reasonable results using whitehat SEO so no idea waste money for blackhat SEO and risk my business.

If your site will be removed from google's index, you're pretty much done with your business.

Smart users can also detect your cloaking by simply visiting your page and then googling for it (click on the google's preview) to see does the site look as in google's preview.

Im quite sure your worst competitors are doing that and they wil report your cloacks In fact, this is what happened to me I believe. I will return the favor of course if i detect cloackings.

 

[Autumn]

Did i called myself a blackhat? I don't think so. Well maybe that guy's system is legit but im not gonna try it out.

I've managed to get reasonable results using whitehat SEO so no idea waste money for blackhat SEO and risk my business.

Then you shouldn't go around posting bold claims like

This method is 100% accurate.

when in fact it is demonstrably NOT 100% accurate at all.

Good on you for posting your code snippet, but you shouldn't go fucking with peoples' livelihoods like that. People make decisions that mean real money based on the info posted on boards so when I see someone spouting bullshit I'm gonna call them on it.

If your site will be removed from google's index, you're pretty much done with your business.

Not if your business is based around continually cranking out cloaked, automatically generated sites at a high margin. And I would remind you that this is a thread about technical IP cloaking, not the pros and cons of cloaking itself - we all know the risks here.

 

[Monrox]

Fantomaster's stuff is nothing special as his lists are constantly leaked and interested parties don't even need to purchase to adjust their bots accordingly. Running satellite companies is a bigger hassle and that method is somewhat slower to detect stuff. Cloaking randomly for 10h a day seems to work fine with rDNS currently.

 

[Autumn]

Fantomaster's stuff is nothing special as his lists are constantly leaked and interested parties don't even need to purchase to adjust their bots accordingly. Running satellite companies is a bigger hassle and that method is somewhat slower to detect stuff. Cloaking randomly for 10h a day seems to work fine with rDNS currently.

There is a big difference between "seems to work fine" and being robust in an industrial sense when you have 100s or 1000s of high profit sites to worry about. You won't see guys with 5000 domains scurrying around trying to find IP lists that are already days old.

I would also add that those guys used to post on another, more technically inclined board than this one, and their bot detection system is anything but "nothing special."

 

[NIXMY]

I was not aware that google is using satellite providers to bust cloakers. Then that fasys guy system makes sense.

How about using the rDNS method and blacklisting satellite providers. I have ip2location just purchased, i could easily blacklist all satellite providers via it. If fasys guy lists are leaked, use both rDNS and those lists Mix things up and try them all out.

Im sure hard work will work out sooner or later.

 

[Monrox]

Days? Guy's not updating for months at times
Read the feedback on that more technically inclined board.

 

[R4z0r]

 

[dribbleonline]

awesome thanks!

 

[orlandolongwood]

According to Google's Webmaster Central (googlewebmastercentral.blogspot.com/2006/09/how-to-verify-googlebot.html) - "Telling webmasters to use DNS to verify on a case-by-case basis seems like the best way to go. I think the recommended technique would be to do a reverse DNS lookup, verify that the name is in the googlebot.com domain, and then do a corresponding forward DNS->IP lookup using that googlebot.com name"

 

[NIXMY]

According to Google's Webmaster Central (googlewebmastercentral.blogspot.com/2006/09/how-to-verify-googlebot.html) - "Telling webmasters to use DNS to verify on a case-by-case basis seems like the best way to go. I think the recommended technique would be to do a reverse DNS lookup, verify that the name is in the googlebot.com domain, and then do a corresponding forward DNS->IP lookup using that googlebot.com name"

That solution has been provided by me, few posts above. Works pretty well with other search engines as well.