Open AI API getting same response.

uniqueaakash13

Registered Member
Joined
Jun 22, 2014
Messages
52
Reaction score
9
Hello everyone,

I'm currently developing an application using the OpenAI API, and I'm aiming to receive a new response each time the API is called. However, I've encountered an issue where I'm getting the same response repeatedly. One workaround I've discovered involves creating the prompt to include all previous messages, then adding a prompt something like "new response other than those mentioned above." This method works but it significantly increases the token count, leading to higher costs.

Has anyone discovered a more efficient approach?
 
PM me your prompt, if you'd like.

You can use a modifier to each prompt to get a different reply each time.
 
This is either a problem in your:
1. code, maybe you stored the output in a variable or instance and called that repeatedly.
2. Prompt, maybe you explicitly state in your latest prompt to add this specific texts in the response.
3. Temperature, the temperature might be very low. Consider increasing the openai temperature
 
Maybe openai assistant concept will help you. That way you can give all instruction to assistant and the pump separate
 
If your prompt is too long/complex, you won't usually get good responses
 
Maybe you should break down larger requests. Instead of sending a single long prompt, you can split it into smaller, more focused questions.
 
Back
Top