1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

Detect bot traffic and proxy

Discussion in 'PHP & Perl' started by traficman, Jun 22, 2015.

  1. traficman

    traficman Newbie

    Joined:
    May 9, 2015
    Messages:
    15
    Likes Received:
    1
    Hello,

    We search for a way to detect all fake traffic like bots traffic and proxy traffic too
    Anyone have an idea ?
     
  2. bartosimpsonio

    bartosimpsonio Jr. VIP Jr. VIP Premium Member

    Joined:
    Mar 21, 2013
    Messages:
    12,489
    Likes Received:
    11,190
    Occupation:
    CHEAP
    Location:
    DATASETS
    Home Page:
    Professional cloakers do this, but their algorithm is "secret".

    Detecting proxies is not easy. You can fake all the data on the headers. But some proxies do identify themselves and you can try to match headers, but that's as much as you can do.
     
  3. HelloInsomnia

    HelloInsomnia Jr. Executive VIP Jr. VIP

    Joined:
    Mar 1, 2009
    Messages:
    1,826
    Likes Received:
    2,939
  4. se900se

    se900se Jr. VIP Jr. VIP

    Joined:
    Oct 14, 2014
    Messages:
    1,249
    Likes Received:
    446
    Occupation:
    Traffic Arbitrage
    Location:
    New York
    Home Page:
    Have you tried Forensiq?
    There's also IAS and DoubleVerify
     
  5. traficman

    traficman Newbie

    Joined:
    May 9, 2015
    Messages:
    15
    Likes Received:
    1
    We search a free method for that
     
  6. mantic0re

    mantic0re Junior Member

    Joined:
    May 29, 2015
    Messages:
    118
    Likes Received:
    9
    What kind of "bots" are you referring to. Crawlers or scripted HTTP requests? If it's crawlers then you can just detect them by looking at the user agent. As for proxies, there are several ways to go about it but none of them will be foolproof. You can for example look at the port that the connection was established from. Also you can compare the IP address of the visitor with a database of known proxies, but that will of course not work if the user has a private proxy.
     
  7. ktommyx

    ktommyx Newbie

    Joined:
    Jul 7, 2013
    Messages:
    10
    Likes Received:
    0
    There is a new solution offered by SEON Security ( seon.io ), they are in beta but some company already use them and their proxy detection is the best. They detect basically any kind of proxy 99%.