Detect bot traffic and proxy
- Thread starter traficman
- Start date
-
- Tags
- bot traffic detect
- Mar 21, 2013
- 24,760
- 31,551
Professional cloakers do this, but their algorithm is "secret".
Detecting proxies is not easy. You can fake all the data on the headers. But some proxies do identify themselves and you can try to match headers, but that's as much as you can do.
Detecting proxies is not easy. You can fake all the data on the headers. But some proxies do identify themselves and you can try to match headers, but that's as much as you can do.
HelloInsomnia
Elite Member
- Mar 1, 2009
- 1,801
- 3,042
Maxmind offers a service for this:
https://www.maxmind.com/en/proxy-detection-service
Stop Forum Spam has an API: http://www.stopforumspam.com/usage
You can also detect non anonymous proxies because they will leak with some simple PHP.
https://www.maxmind.com/en/proxy-detection-service
Stop Forum Spam has an API: http://www.stopforumspam.com/usage
You can also detect non anonymous proxies because they will leak with some simple PHP.
D
Deleted member 813988
Guest
Have you tried Forensiq?
There's also IAS and DoubleVerify
There's also IAS and DoubleVerify
What kind of "bots" are you referring to. Crawlers or scripted HTTP requests? If it's crawlers then you can just detect them by looking at the user agent. As for proxies, there are several ways to go about it but none of them will be foolproof. You can for example look at the port that the connection was established from. Also you can compare the IP address of the visitor with a database of known proxies, but that will of course not work if the user has a private proxy.