CPA-Qion
Newbie
- Mar 16, 2010
- 4
- 0
Hi,
I have a site that have a huge problem when it comes to DMCA removal in google. We don't have any copywrited material and you cant download any torrents. So i guess they are bots that crawl our site because they think its infringement.
I want to block these bots. I'm thinking of two ways of doing this with htaccess.
1. Only allow referrer from "google.tld" and googlebot (97% of the traffic is from google)
- Do you think the bots have a referrer in their user agent? In that case this wouldn't work
2. Only allow browers "mozilla" "chrome" etc and google bot.
What do you guys think would be the best solution? Is it even possible?
Have a nice day!
I have a site that have a huge problem when it comes to DMCA removal in google. We don't have any copywrited material and you cant download any torrents. So i guess they are bots that crawl our site because they think its infringement.
I want to block these bots. I'm thinking of two ways of doing this with htaccess.
1. Only allow referrer from "google.tld" and googlebot (97% of the traffic is from google)
- Do you think the bots have a referrer in their user agent? In that case this wouldn't work
2. Only allow browers "mozilla" "chrome" etc and google bot.
What do you guys think would be the best solution? Is it even possible?
Have a nice day!