Rate Limiting

What it is

Rate limiting restricts how many API requests you can make within a time period. Limits might be requests per minute, tokens per minute, or tokens per day. Exceeding limits results in errors until the limit resets. Higher-tier plans typically have higher limits.

Why it matters

Rate limits affect how you build applications. High-volume use cases need to handle rate limit errors gracefully—queueing requests, implementing backoff strategies, or distributing across multiple accounts. Understanding your rate limits is essential for reliable AI-powered applications.