How To block DMCA Bots with CloudFlare

[filiposlovni]

Those weird DMCA bots are getting out of hand randomly sending copyrights for content that is not copyrighted just by searching titles and stuff... So I was wondering if they can get blocked from accessing my website...
So this CloudFlare rule for bots might help out and I will put it on all my websites and see if those weirdos stop sending those DMCA notices... So this is basically a study of some sort lol, if you are interested you can do the same and report the results on your side.





Expression Preview:
(http.user_agent contains "Yandex") or (http.user_agent contains "muckrack") or (http.user_agent contains "Qwantify") or (http.user_agent contains "Sogou") or (http.user_agent contains "BUbiNG") or (http.user_agent contains "knowledge") or (http.user_agent contains "CFNetwork") or (http.user_agent contains "Scrapy") or (http.user_agent contains "SemrushBot") or (http.user_agent contains "AhrefsBot") or (http.user_agent contains "Baiduspider") or (http.user_agent contains "python-requests") or (http.user_agent contains "crawl" and not cf.client.bot) or (http.user_agent contains "Crawl" and not cf.client.bot) or (http.user_agent contains "bot" and not http.user_agent contains "bingbot" and not http.user_agent contains "Google" and not http.user_agent contains "Twitter" and not cf.client.bot) or (http.user_agent contains "Bot" and not http.user_agent contains "Google" and not cf.client.bot) or (http.user_agent contains "Spider" and not cf.client.bot) or (http.user_agent contains "spider" and not cf.client.bot)
Block action.

 

[filiposlovni]

Update:

https://www.blackhatworld.com/seo/how-to-fool-dmca-bots-and-use-any-hosting-instead-of-having-to-use-offshore.1393516/

 

[satyr85]

Blocking some useragents wont give you anything. Changing useragent is easy as 2+2, bypasing cloudflare bot protection is also doable. Offshore hosting is the only way.

 

[somewebmaster]

Blocking some useragents wont give you anything. Changing useragent is easy as 2+2, bypasing cloudflare bot protection is also doable. Offshore hosting is the only way.

so ignoring dmca is enough? because "you" are offshore they can't press your hosting provider, it is ok
but what about google? shouldn't too many unanswered dmca request bring, in time, some kind of punishment from google, like deindexing those pages?

 

[painurek]

there's a lot of type of bots , there's a web browser bots act like a normal visitor unless, besides dcma companies doesn't search in the website only but also in search engine too

 

[filiposlovni]

there's a lot of type of bots , there's a web browser bots act like a normal visitor unless, besides dcma companies doesn't search in the website only but also in search engine too

Check the update i found ultimate solution against DMCA bots

 

[cyborg24]

Those weird DMCA bots are getting out of hand randomly sending copyrights for content that is not copyrighted just by searching titles and stuff... So I was wondering if they can get blocked from accessing my website...
So this CloudFlare rule for bots might help out and I will put it on all my websites and see if those weirdos stop sending those DMCA notices... So this is basically a study of some sort lol, if you are interested you can do the same and report the results on your side.

So, did it work?

 

[filiposlovni]

So, did it work?

It worked for some types, and for some other it did not, because of that i found second and ultimate solution that i sent link on the second post of this thread.
Heres that second solution: https://www.blackhatworld.com/seo/how-to-fool-dmca-bots-and-use-any-hosting-instead-of-having-to-use-offshore.1393516/

 

[painurek]

Check the update i found ultimate solution against DMCA bots

does it work woth google search removal ?

 

[filiposlovni]

does it work woth google search removal ?

Yeah but use some wordpress plugin or noindex tag since gsc removal lasts only 6 months

 

[SL1DE]

I just put "I'm under attack" mode on and that seems to help with copyright bots and also allows Google, Bing, etc to crawl so you can still be ranked on search engines.

 

[painurek]

I just put DDoS protection on and that seems to help with copyright bots and also allows Google, Bing, etc to crawl so you can still be ranked on search engines.

any idea how to deploy it i have pro plan on cloudflare

 

[SL1DE]

any idea how to deploy it i have pro plan on cloudflare

I made a mistake, I meant "I'm Under Attack" mode lol

 

[black_bgd]

Blocking some useragents wont give you anything. Changing useragent is easy as 2+2, bypasing cloudflare bot protection is also doable. Offshore hosting is the only way.

Same story here, grab some offshore hosting and you are good to go

 

[charto03]

so ignoring dmca is enough? because "you" are offshore they can't press your hosting provider, it is ok
but what about google? shouldn't too many unanswered dmca request bring, in time, some kind of punishment from google, like deindexing those pages?

I think he's saying he's getting those spam messages to remove images becasuse they can access the site so blocking the bots access is reducing the inbound messages, if I understood correctly?

 

[somewebmaster]

I think he's saying he's getting those spam messages to remove images becasuse they can access the site so blocking the bots access is reducing the inbound messages, if I understood correctly?

i'm getting a different version of dmca spam: their bot searches for keywords, and then without real control of the content, they apply to google and google presses me, and then i must prove to google that there's no dmca case
for me hosting offshore doesn't help
what can be done in my case? i'm sure i'm not the only one

 

[charto03]

i'm getting a different version of dmca spam: their bot searches for keywords, and then without real control of the content, they apply to google and google presses me, and then i must prove to google that there's no dmca case
for me hosting offshore doesn't help
what can be done in my case? i'm sure i'm not the only one

Ah thats super helpful then to block the bots that way. I do reputation work where we are typically on the other side of it when content is stolen.

 

[painurek]

i'm getting a different version of dmca spam: their bot searches for keywords, and then without real control of the content, they apply to google and google presses me, and then i must prove to google that there's no dmca case
for me hosting offshore doesn't help
what can be done in my case? i'm sure i'm not the only one

i have Sane problem

 

[infinity_marketing]

On cloudflare there is an option called "Under attack" try to activate that mode, it will add extra layer of protection on your website.

 

[painurek]

On cloudflare there is an option called "Under attack" try to activate that mode, it will add extra layer of protection on your website.

the problem it can be bypassed if they use headless browser