temperature

Temperature and top-p: how an AI actually picks its next word Lesson

A language model does not know its next word - it produces a list of odds and then rolls dice. The rules of that dice roll are why the same prompt gives you a boring answer one day and a wild one the next.