Slides / VideoIntermediate

Decoding Parameters: Temperature, Top-p, Max Tokens

Temperature and top-p shape how random the model's word choices are, while max tokens caps the response length.

Slide 1
1 / 6