How to block adsense id and amazon id scraper bots

[Nichekid]

Hi Guys, how do you block bots that reverse engineer and reveal your entire money network to your competitors by either your adsense publisher id, amazon affiliate tag, ip address especially when you are using a vps to host all your websites?

It is hard to digest when someone steals all our keywords (which we found after hours of research ) just by finding one of our websites. Can i use the same .htaccess code used for blocking bots in pbn?

Is getting a different ip for each domain in the same vps a good idea? I use knownhost.

 

[Nichekid]

can anyone shed some light on this

 

[starki]

Since they don't indentify themselves by user agent for a reason, they are hard to block. You'd have to find their IP and hope they don't use multiple or changing IPs for crawling.

At least for Amazon you can kinda circumvent the problem by simply creating a new AssociateTag for every site. Don't know the exact limit, but you can make dozens of these IDs/tags in the same account.

As far as other affiliate programs are concerned: Many don't care if you have multiple accounts if you explain why or even create additional IDs for you in the same account by request.

Masking you links (no cloaking, a simple internal URL -> 301 external URL, or even a third party shortener) will help, too, most of these search engines aren't really sophisticated and just look for IDs in the code of your site.

As far as Adsense is concerned: Bad luck, no way to hide without violating the Adsense Guidelines.

 

[Mr.Charles]

Hello if you can do it through .htaccess to block bots, but also has the option through adsense, block specific sites. For example there are people who take your adsense code for testing, it is best to block that site is receiving impressions of your ads.

 

[starki]

@chiqui3d: He's talking about source code/affiliate ID search engines. These sites don't use the IDs for testing or similar, they crawl source code and allow users find strings in the source code of the sites they crawled. Finding their IPs (which would be required for blocking via .htaccess) is pretty much impossible if they use unsuspicious user agents.

 

[Mr.Charles]

@chiqui3d: He's talking about source code/affiliate ID search engines. These sites don't use the IDs for testing or similar, they crawl source code and allow users find strings in the source code of the sites they crawled. Finding their IPs (which would be required for blocking via .htaccess) is pretty much impossible if they use unsuspicious user agents.

True Buddy, then the only way is to do research that scans your web. Then Block it by ip or ip range.

Any advice or opinion about it, is welcome.