Black Hat AI!

bartosimpsonio

Elite Member

Executive VIP

Jr. VIP

Mar 21, 2013

24,764

31,552

• Aug 4, 2025

• #1

These techniques are straight out of the BHW cookbook!!

https://blog.cloudflare.com/perplex...rawlers-to-evade-website-no-crawl-directives/

 

Opulentos

Failure to resolve dispute

Apr 30, 2020

788

1,769

• Aug 4, 2025

• #2

Extremely black hat. Wonder how long they were getting away with scraping tonnes of content with that little back door trick

 

bartosimpsonio

Elite Member

Executive VIP

Jr. VIP

Mar 21, 2013

24,764

31,552

• Aug 4, 2025
• Thread Starter Thread Starter

• #3

 

L

llmafk

Newbie

Feb 15, 2024

16

8

• Aug 6, 2025

• #4

They all do it. Amazons AI crawler rolled in with a ghosted user agent and practically DDosed this guy’s Git server . https://xeiaso.net/notes/2025/amazon-crawler/

 

4440

Elite Member

Jr. Executive VIP

Jr. VIP

Jun 23, 2021

1,510

1,557

• Aug 7, 2025

• #5

I know they are doing it, but I did not expect the first one to be exposed to be Perplexity.
How soon will we see 'clockers' specifically built to pollute AI scrapers—like providing wrong answers to AI bots on purpose?

That seems like a good business.

 

1SEOWarrior

Elite Member

Jr. VIP

Oct 29, 2021

8,357

3,590

• Aug 7, 2025

• #6

Even google deny robots.txt directive.

Who cares!!! attitude everywhere in the industry.