FlashcardBeginner
Rate Limits
Rate limits cap how many requests or tokens you can send in a time window.
Question
What are rate limits on an LLM API?
Click to reveal answer
Rate limits cap how many requests or tokens you can send in a time window.
What are rate limits on an LLM API?