malayan
Power Member
- Aug 26, 2020
- 608
- 553
Hey y'all, I'm new to this blocking robots game and I'm seeing how insidious it can get.
My site is an intelligence site with a ton of data that's already the target of a bunch of scrapers and they're killing my memory. Sometimes my server's at 99% memory utilization:
and Cloudflare's starting sending me warnings about the amount of bot traffic on the server
Aside from turning on Cloudflare's Bot security what else would you normally do to fight these types of attacks?
My site is an intelligence site with a ton of data that's already the target of a bunch of scrapers and they're killing my memory. Sometimes my server's at 99% memory utilization:
and Cloudflare's starting sending me warnings about the amount of bot traffic on the server
Aside from turning on Cloudflare's Bot security what else would you normally do to fight these types of attacks?