messages
parameter as a string. Support for other object types will be added in future releases.llama-4-scout-17b-16e-instruct
llama3.1-8b
llama-3.3-70b
llama-4-maverick-17b-128e
qwen-3-32b
qwen-3-235b-a22b
deepseek-r1-distill-llama-70b
(private preview)deepseek-r1-distill-llama-70b
are available in private preview. Please contact us to request access.{ "type": "json_schema", "json_schema": { "name": "schema_name", "strict": true, "schema": {...} } }
enforces schema compliance. The schema must follow standard JSON Schema format with the following properties:Note: Structured outputs with JSON schema is currently in beta. Visit our page on Structured Outputs for more information.seed
and parameters should return the same result. Determinism is not guaranteed.none
means the model will not call any tool and instead generates a message. auto
means the model can pick between generating a message or calling one or more tools. required means the model must call one or more tools. Specifying a particular tool via {"type": "function", "function": {"name": "my_function"}}
forces the model to call that tool.none
is the default when no tools are present. auto
is the default if tools are present.False
logprobs
must be set to true if this parameter is used.