Enums
Architecture
Section titled “Architecture”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
Architecture.Mistral |
'mistral' |
Architecture.Gemma |
'gemma' |
Architecture.Mixtral |
'mixtral' |
Architecture.Llama |
'llama' |
Architecture.Phi2 |
'phi2' |
Architecture.Phi3 |
'phi3' |
Architecture.Qwen2 |
'qwen2' |
Architecture.Gemma2 |
'gemma2' |
Architecture.Starcoder2 |
'starcoder2' |
Architecture.Phi3_5MoE |
'phi3.5moe' |
Architecture.DeepseekV2 |
'deepseekv2' |
Architecture.DeepseekV3 |
'deepseekv3' |
Architecture.Qwen3 |
'qwen3' |
Architecture.GLM4 |
'glm4' |
Architecture.GLM4Moe |
'glm4moe' |
Architecture.GLM4MoeLite |
'glm4moelite' |
Architecture.Qwen3Moe |
'qwen3moe' |
Architecture.SmolLm3 |
'smollm3' |
Architecture.GraniteMoeHybrid |
'granitemoehybrid' |
Architecture.GptOss |
'gptoss' |
Architecture.Qwen3Next |
'qwen3next' |
Architecture.Lfm2 |
'lfm2' |
Architecture.Lfm2Moe |
'lfm2_moe' |
EmbeddingArchitecture
Section titled “EmbeddingArchitecture”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
EmbeddingArchitecture.EmbeddingGemma |
'embeddinggemma' |
EmbeddingArchitecture.Qwen3Embedding |
'qwen3embedding' |
MultimodalArchitecture
Section titled “MultimodalArchitecture”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
MultimodalArchitecture.Phi3V |
'phi3v' |
MultimodalArchitecture.Idefics2 |
'idefics2' |
MultimodalArchitecture.LLaVANext |
'llava-next' |
MultimodalArchitecture.LLaVA |
'llava' |
MultimodalArchitecture.Lfm2Vl |
'lfm2vl' |
MultimodalArchitecture.VLlama |
'vllama' |
MultimodalArchitecture.Qwen2VL |
'qwen2vl' |
MultimodalArchitecture.Idefics3 |
'idefics3' |
MultimodalArchitecture.MiniCpmO |
'minicpmo' |
MultimodalArchitecture.Phi4MM |
'phi4mm' |
MultimodalArchitecture.Qwen2_5VL |
'qwen2_5vl' |
MultimodalArchitecture.Gemma3 |
'gemma3' |
MultimodalArchitecture.Mistral3 |
'mistral3' |
MultimodalArchitecture.Llama4 |
'llama4' |
MultimodalArchitecture.Gemma3n |
'Gemma3n' |
MultimodalArchitecture.Qwen3VL |
'Qwen3VL' |
MultimodalArchitecture.Qwen3VLMoE |
'Qwen3VLMoE' |
MultimodalArchitecture.Qwen3_5 |
'Qwen3_5' |
MultimodalArchitecture.Qwen3_5Moe |
'Qwen3_5Moe' |
MultimodalArchitecture.Qwen4Exp |
'Qwen4Exp' |
MultimodalArchitecture.Voxtral |
'Voxtral' |
MultimodalArchitecture.Gemma4 |
'Gemma4' |
MultimodalArchitecture.MuseGlimmer |
'MuseGlimmer' |
MultimodalArchitecture.DiffusionGemma |
'DiffusionGemma' |
DiffusionArchitecture
Section titled “DiffusionArchitecture”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
DiffusionArchitecture.Flux |
'flux' |
DiffusionArchitecture.FluxOffloaded |
'flux-offloaded' |
SpeechLoaderType
Section titled “SpeechLoaderType”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
SpeechLoaderType.Dia |
'Dia' |
ModelDType
Section titled “ModelDType”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
ModelDType.Auto |
'auto' |
ModelDType.BF16 |
'bf16' |
ModelDType.F16 |
'f16' |
ModelDType.F32 |
'f32' |
IsqOrganization
Section titled “IsqOrganization”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
IsqOrganization.Default |
'default' |
IsqOrganization.MoQE |
'moqe' |
ImageGenerationResponseFormat
Section titled “ImageGenerationResponseFormat”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
ImageGenerationResponseFormat.Url |
'Url' |
ImageGenerationResponseFormat.B64Json |
'B64Json' |
ToolChoice
Section titled “ToolChoice”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
ToolChoice.NoTools |
'None' |
ToolChoice.Auto |
'Auto' |
SearchContextSize
Section titled “SearchContextSize”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
SearchContextSize.Low |
'low' |
SearchContextSize.Medium |
'medium' |
SearchContextSize.High |
'high' |
AgentPermission
Section titled “AgentPermission”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
AgentPermission.Auto |
'auto' |
AgentPermission.Ask |
'ask' |
AgentPermission.Deny |
'deny' |
CodeExecutionPermission
Section titled “CodeExecutionPermission”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
CodeExecutionPermission.Auto |
'auto' |
CodeExecutionPermission.Ask |
'ask' |
CodeExecutionPermission.Deny |
'deny' |
NetworkMode
Section titled “NetworkMode”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
NetworkMode.NoNetwork |
'none' |
NetworkMode.Loopback |
'loopback' |
NetworkMode.Full |
'full' |
AgentToolSource
Section titled “AgentToolSource”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
AgentToolSource.BuiltIn |
'built_in' |
AgentToolSource.User |
'user' |
AgentToolSource.Mcp |
'mcp' |
AgentToolSource.External |
'external' |
AgentToolKind
Section titled “AgentToolKind”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
AgentToolKind.CodeExecution |
'code_execution' |
AgentToolKind.WebSearch |
'web_search' |
AgentToolKind.Shell |
'shell' |
AgentToolKind.File |
'file' |
AgentToolKind.Custom |
'custom' |
AgentToolKind.External |
'external' |
AgentToolApprovalDecisionKind
Section titled “AgentToolApprovalDecisionKind”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
AgentToolApprovalDecisionKind.Approve |
'approve' |
AgentToolApprovalDecisionKind.Deny |
'deny' |
PagedCacheType
Section titled “PagedCacheType”Members and their wire/config names where relevant. The members are fieldless PyO3 enum variants and do not expose .value.
| Member | Wire/config name |
|---|---|
PagedCacheType.Auto |
0 |
PagedCacheType.F8E4M3 |
1 |
Generated from mistralrs-pyo3/mistralrs.pyi.