Context Length

Free Tier8k tokens
Paid Tiers32k tokens

Speed

~2200
tokens/sec

Input / Output

Input Formats JSON, plain text
Output FormatsJSON, plain text, structured

Pricing

Input
$0.10 / M tokens
Output
$0.10 / M tokens
Exploration pricing shown above is per million tokens. For volume discounts and enterprise features, see our pricing page.

Model Notes

Model ID: llama3.1-8b

Rate Limits

TierRequests/minInput Tokens/minOutput Tokens/minDaily Tokens
Free3060k8k/request1M
1600600k60k245M
210001M100k415M

Endpoints

Chat Completions
Completions

Features

Streaming
Structured Outputs
Tool Calling
Tool Calling w/ Structured Outputs

Need Higher Limits?

Reach out for custom pricing with our Enterprise tier for higher rate limits and dedicated support.Contact Sales