Streaming Responses

Streaming delivers the model's output token by token as it is generated.

Question

What does streaming an API response mean?

Click to reveal answer