Slides / VideoIntermediate
Decoding Parameters: Temperature, Top-p, Max Tokens
Temperature and top-p shape how random the model's word choices are, while max tokens caps the response length.
1 / 6
Temperature and top-p shape how random the model's word choices are, while max tokens caps the response length.