[HELP] Does Hugging Face Open AI detector work correctly?

[TooCorny]

Well recently discovered this tool to detect AI Generated Text

Tested a few articles written by my writers in the tool and to my surprise, the results were mixed.

In some articles the tool gives a 99% Fake Output and in others it gives a 99% Original

I am pretty sure my writers are not using AI tools, but who knows


Has anybody tested this tool and knows if it works properly?

 

[Cognitive]

Well recently discovered this tool to detect AI Generated Text

Tested a few articles written by my writers in the tool and to my surprise, the results were mixed.

In some articles the tool gives a 99% Fake Output and in others it gives a 99% Original

I am pretty sure my writers are not using AI tools, but who knows


Has anybody tested this tool and knows if it works properly?

Yes, it works properly but you need to make sure that the content you want to check contains at least 50 tokens (ideally, 500 tokens would be needed)

 

[TooCorny]

Yes, it works properly but you need to make sure that the content you want to check contains at least 50 tokens (ideally, 500 tokens would be needed)

It seems weird to me because I tested different chunks of text and some of them were AI and it said they were 99% real

 

[PinguSpy]

Not really accurate. Tested with few wikipedia content, and it marked as 99% a.i

 

[TooCorny]

Not really accurate. Tested with few wikipedia content, and it marked as 99% a.i

Yeah that is what I was suspecting. Thanks for the insight, was going crazy

 

[Alexion]

I tested it with content written by me, and said it was A.I. content.
I tested articles from openAI and said it's original.

It does detect it sometimes, but I don't find it accurate overall.