Contents

Rate limits

Region

Limits are per key, per region.

LimitDefault
Requests per minute60
Tokens per minute200k

Default limits. Contact us to raise them.

Every response carries the current state:

Headers
x-ratelimit-limit-requests: 60
x-ratelimit-remaining-requests: 47
x-ratelimit-reset-requests: 12
retry-after: 12            # only on 429 and 503

Over the limit, the request returns 429 with the code rate_limited. Wait for retry-after seconds and send it again.