API Reference#
All endpoints are prefixed with /v1. Requests and responses use Content-Type: application/json unless noted.
Streaming endpoints respond with Content-Type: text/event-stream. Each SSE event is a JSON line:
data: {"event":"delta","text":"..."}
data: {"event":"done"}On error:
data: {"event":"error","message":"..."}Sections#
- Generation — text generation, streaming, JSON output, KV sessions, MTP, model metadata
- Embeddings — embedding vectors
- Whisper — speech-to-text
- Stable Diffusion — image and video generation
- Multimodal — vision-language streaming