AI & LLMs

Temperature

The decoding dial that flattens or sharpens the next-token distribution.

Temperature divides the logits before the softmax. Low temperature sharpens the distribution (safe, repetitive; near 0 is greedy); high temperature flattens it (diverse, eventually incoherent). Paired with top-k / top-p to control randomness.