OccultKingdoms
BANNED
- Mar 11, 2013
- 5,542
- 9,844
That sounds like our brains. Doesn't it?A machine learning model will produce totally different outputs for the same input each time you run it. (Providing of course the hyperparameter temperature is high enough). But a machine learning model returns multiple options at each step and chooses one to use. This is also what the decoder hyperparameters top-k and top-p are for. To tweak what tokens are chosen. top-p is tokens who have a probability above the top-p and top-k is the top k tokens.