Anyone using logit bias?

MAF Publishing

Regular Member
Joined
Jun 26, 2023
Messages
480
Reaction score
354
I'm tempted to use it as a filter, but it seems like you would have to be very careful to not cut out tokens for common prefixes and similar. And the token cost of that extra overhead in the API call could add up. Anyone using bias successfully with GPT?
 
Back
Top