Context Length

Free Tier8,192 tokens
Paid TiersUp to 32k

Speed

~2600
tokens/sec

Input / Output

Input Formats JSON, plain text
Output FormatsJSON, plain text, structured

Rate Limits

TierRequests/minInput Tokens/minOutput Tokens/minDaily Tokens
Free3060k-1M
1300300k30k54M
2600600k60k115M
310001M100K185M
412001.2M120k255M
514501.45M145k365M

Endpoints

Chat Completions
Completions

Features

Streaming
Structured Outputs
Streaming w/ Structured Outputs
Tool Calling
Multi-Turn Tool Calling
Tool Calling w/ Structured Outputs
Top P
Temperature
Max Completion Tokens
Logit Probabilities

Need Higher Limits?

Reach out for custom pricing with our Enterprise tier for higher rate limits and dedicated support.

Contact Sales