GPT Fine-tuning: 4o-mini allowing it/ 4o is blocking it | Any known solution?

Niklas03

Newbie
Joined
Nov 10, 2023
Messages
19
Reaction score
14
Hello Community,

It's a known problem, but I wanted to see if there are any new updates about it.

The problem is: Fine-tuning is possible on gpt-3.5 and 4o-mini, but not on 4o.

On lower models, the training runs without problems, but on 4o, I’m getting one of the typical errors:

"The job failed due to an invalid training file. This training file was blocked by our moderation system because it contains too many examples that violate OpenAI's usage policies, or because it attempts to create model outputs that violate OpenAI's usage policies."

But if my content is violating the policies, why is it working on lower models? Is it because gpt-4o is more advanced, more intelligent, and able to detect more issues in my training files than lower models?

And besides that, has anyone figured out any trick to bypass this? Except for the usual solution: "Try and repeat."
Would appreciate any help!
 
Is it because gpt-4o is more advanced, more intelligent, and able to detect more issues in my training files than lower models?
Yes, Exactly you have the answer already, If your content break Openai TOS, Then it will detect at 4o, As GPT4o is the more powerful and intelligent than the 4o-mini.
 
Yes, Exactly you have the answer already, If your content break Openai TOS, Then it will detect at 4o, As GPT4o is the more powerful and intelligent than the 4o-mini.
Mhm, thanks for the answer!. Do you maybe know about any alternative models (from other company's) with the same or at least more intelligent then 4o-mini that you can train aswell? Is there anything out there?
 
Back
Top