FlashcardIntermediate
Cost and Latency in Prompt Design
Longer prompts and outputs increase token usage, driving up both cost and response latency.
Question
How do prompt design choices affect cost and latency?
Click to reveal answer
Longer prompts and outputs increase token usage, driving up both cost and response latency.
How do prompt design choices affect cost and latency?