Skip to content

Reference

For step-by-step instructions, start with the quickstart or choose a model.

Looking for Reference
Model support Model families, GGUF, quantization types
HTTP requests Endpoints, OpenAI compatibility, decisions
Native SDKs Python, Rust
CLI and configuration Commands, TOML, environment variables
Installation Hardware, installer, Cargo features
Tools and execution MCP configuration, sandbox
Operations Metrics, troubleshooting
File formats UQFF

Implementation and contributor documentation lives in the Developer Guide.