Prompt + response = total tokens. How long is your prompt?
Also, if it can give you the response using less tokens, it generally will. Ask gpt 4 (8k tokens) to make you a long list of something that has many thousands of things.. like words from the dictionary, and see how far it will go before...
It will start to forget the beginning as soon as you hit the token limit. You could use gpt-4-32k, if you have access, which will give you around 20k words of instruction.
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.