Compatibility
Region
The OpenAI and Anthropic SDKs work unchanged. Set the base URL and the key and nothing else.
Served
- Chat completions,
POST /v1/chat/completions - Responses,
POST /v1/responses - Messages,
POST /v1/messages, the Anthropic shape - Streaming
- Tool calls
- JSON mode,
response_format - Model list,
GET /v1/models
Not served
- Embeddings
- Images
- Audio
- Files
- Assistants
- Batches
- Fine-tuning
A request to a path that is not served returns 404 with the code not_found.