1. This site uses cookies. By continuing to use this site, you are agreeing to our use of cookies. Learn More.

How to block adsense id and amazon id scraper bots

Discussion in 'Black Hat SEO' started by Nichekid, Sep 12, 2016.

  1. Nichekid

    Nichekid Jr. VIP Jr. VIP

    Joined:
    Jan 13, 2012
    Messages:
    165
    Likes Received:
    13
    Gender:
    Male
    Location:
    This Big World
    Hi Guys, how do you block bots that reverse engineer and reveal your entire money network to your competitors by either your adsense publisher id, amazon affiliate tag, ip address especially when you are using a vps to host all your websites?

    It is hard to digest when someone steals all our keywords (which we found after hours of research ) just by finding one of our websites. Can i use the same .htaccess code used for blocking bots in pbn?

    Is getting a different ip for each domain in the same vps a good idea? I use knownhost.
     
  2. Nichekid

    Nichekid Jr. VIP Jr. VIP

    Joined:
    Jan 13, 2012
    Messages:
    165
    Likes Received:
    13
    Gender:
    Male
    Location:
    This Big World
    can anyone shed some light on this
     
  3. starki

    starki Power Member

    Joined:
    Jul 17, 2012
    Messages:
    689
    Likes Received:
    220
    Since they don't indentify themselves by user agent for a reason, they are hard to block. You'd have to find their IP and hope they don't use multiple or changing IPs for crawling.

    At least for Amazon you can kinda circumvent the problem by simply creating a new AssociateTag for every site. Don't know the exact limit, but you can make dozens of these IDs/tags in the same account.

    As far as other affiliate programs are concerned: Many don't care if you have multiple accounts if you explain why or even create additional IDs for you in the same account by request.

    Masking you links (no cloaking, a simple internal URL -> 301 external URL, or even a third party shortener) will help, too, most of these search engines aren't really sophisticated and just look for IDs in the code of your site.

    As far as Adsense is concerned: Bad luck, no way to hide without violating the Adsense Guidelines.
     
  4. Mr.Charles

    Mr.Charles Jr. VIP Jr. VIP

    Joined:
    Apr 6, 2012
    Messages:
    369
    Likes Received:
    30
    Gender:
    Male
    Occupation:
    Web Developer
    Location:
    Google
    Home Page:
    Hello if you can do it through .htaccess to block bots, but also has the option through adsense, block specific sites. For example there are people who take your adsense code for testing, it is best to block that site is receiving impressions of your ads.
     
  5. starki

    starki Power Member

    Joined:
    Jul 17, 2012
    Messages:
    689
    Likes Received:
    220
    @chiqui3d: He's talking about source code/affiliate ID search engines. These sites don't use the IDs for testing or similar, they crawl source code and allow users find strings in the source code of the sites they crawled. Finding their IPs (which would be required for blocking via .htaccess) is pretty much impossible if they use unsuspicious user agents.
     
  6. Mr.Charles

    Mr.Charles Jr. VIP Jr. VIP

    Joined:
    Apr 6, 2012
    Messages:
    369
    Likes Received:
    30
    Gender:
    Male
    Occupation:
    Web Developer
    Location:
    Google
    Home Page:
    True Buddy, then the only way is to do research that scans your web. Then Block it by ip or ip range.

    Any advice or opinion about it, is welcome.