Non-Determinism of Outputs

LLMs can produce different responses to the same prompt due to randomness in generation.

Question

Why do LLMs give different answers to the same prompt?

Click to reveal answer