| DiffusionGemma |
google/diffusiongemma-26B-A4B-it
mistralrs run -m google/diffusiongemma-26B-A4B-it |
DiffusionGemmaForBlockDiffusion |
| Gemma 3 |
google/gemma-3-12b-it
mistralrs run -m google/gemma-3-12b-it |
Gemma3ForConditionalGeneration |
| Gemma 3n |
google/gemma-3n-E4B-it
mistralrs run -m google/gemma-3n-E4B-it |
Gemma3nForConditionalGeneration |
| Gemma 4 |
google/gemma-4-E4B-it (E4B), google/gemma-4-26B-A4B-it (26B-A4B MoE), google/gemma-4-31B-it (31B dense)
mistralrs run -m google/gemma-4-E4B-it
mistralrs run -m google/gemma-4-26B-A4B-it
mistralrs run -m google/gemma-4-31B-it |
Gemma4ForConditionalGeneration |
| Idefics2 |
HuggingFaceM4/idefics2-8b
mistralrs run -m HuggingFaceM4/idefics2-8b |
Idefics2ForConditionalGeneration |
| Idefics3, SmolVLM |
HuggingFaceM4/Idefics3-8B-Llama3
mistralrs run -m HuggingFaceM4/Idefics3-8B-Llama3 |
Idefics3ForConditionalGeneration |
| LFM2-VL, LFM2.5-VL |
LiquidAI/LFM2.5-VL-1.6B (1.6B), LiquidAI/LFM2.5-VL-450M (450M)
mistralrs run -m LiquidAI/LFM2.5-VL-1.6B
mistralrs run -m LiquidAI/LFM2.5-VL-450M |
Lfm2VlForConditionalGeneration |
| LFM3-Audio |
LiquidAI/LFM3-Audio-2B
mistralrs run -m LiquidAI/LFM3-Audio-2B |
Lfm3AudioForConditionalGeneration |
| LFM3-Omni |
LiquidAI/LFM3-Omni-2B
mistralrs run -m LiquidAI/LFM3-Omni-2B |
Lfm3OmniForConditionalGeneration |
| LFM3-VL |
LiquidAI/LFM3-VL-2B
mistralrs run -m LiquidAI/LFM3-VL-2B |
Lfm3VlForConditionalGeneration |
| Llama 3.2 Vision |
meta-llama/Llama-3.2-11B-Vision-Instruct
mistralrs run -m meta-llama/Llama-3.2-11B-Vision-Instruct |
MllamaForConditionalGeneration |
| Llama 4 |
meta-llama/Llama-4-Scout-17B-16E-Instruct
mistralrs run -m meta-llama/Llama-4-Scout-17B-16E-Instruct |
Llama4ForConditionalGeneration |
| LLaVA 1.5 |
llava-hf/llava-1.5-7b-hf
mistralrs run -m llava-hf/llava-1.5-7b-hf |
LlavaForConditionalGeneration |
| LLaVA-NeXT |
llava-hf/llava-v1.6-mistral-7b-hf
mistralrs run -m llava-hf/llava-v1.6-mistral-7b-hf |
LlavaNextForConditionalGeneration |
| MiniCPM-o |
openbmb/MiniCPM-o-2_6
mistralrs run -m openbmb/MiniCPM-o-2_6 |
MiniCPMO |
| Mistral Small 3 |
mistralai/Mistral-Small-3.2-24B-Instruct-2506
mistralrs run -m mistralai/Mistral-Small-3.2-24B-Instruct-2506 |
Mistral3ForConditionalGeneration |
| Muse Glimmer |
meta-models/Muse-Glimmer-30B
mistralrs run -m meta-models/Muse-Glimmer-30B |
MuseGlimmerForConditionalGeneration |
| Phi-3.5-Vision |
microsoft/Phi-3.5-vision-instruct
mistralrs run -m microsoft/Phi-3.5-vision-instruct |
Phi3VForCausalLM |
| Phi-4-multimodal |
microsoft/Phi-4-multimodal-instruct
mistralrs run -m microsoft/Phi-4-multimodal-instruct |
Phi4MMForCausalLM |
| Qwen 3.5, Qwen 3.6 |
Qwen/Qwen3.5-27B (3.5), Qwen/Qwen3.6-27B (3.6)
mistralrs run -m Qwen/Qwen3.5-27B
mistralrs run -m Qwen/Qwen3.6-27B |
Qwen3_5ForConditionalGeneration |
| Qwen 3.5 MoE, Qwen 3.6 MoE |
Qwen/Qwen3.5-35B-A3B (3.5), Qwen/Qwen3.6-35B-A3B (3.6)
mistralrs run -m Qwen/Qwen3.5-35B-A3B
mistralrs run -m Qwen/Qwen3.6-35B-A3B |
Qwen3_5MoeForConditionalGeneration |
| Qwen2-VL |
Qwen/Qwen2-VL-7B-Instruct
mistralrs run -m Qwen/Qwen2-VL-7B-Instruct |
Qwen2VLForConditionalGeneration |
| Qwen2.5-VL |
Qwen/Qwen2.5-VL-7B-Instruct
mistralrs run -m Qwen/Qwen2.5-VL-7B-Instruct |
Qwen2_5_VLForConditionalGeneration |
| Qwen3-VL |
Qwen/Qwen3-VL-4B-Instruct
mistralrs run -m Qwen/Qwen3-VL-4B-Instruct |
Qwen3VLForConditionalGeneration |
| Qwen3-VL MoE |
Qwen/Qwen3-VL-235B-A22B-Instruct
mistralrs run -m Qwen/Qwen3-VL-235B-A22B-Instruct |
Qwen3VLMoeForConditionalGeneration |
| Qwen3.8-Flash-Next |
Qwen/Qwen3.8-Flash-Next
mistralrs run -m Qwen/Qwen3.8-Flash-Next |
Qwen4ExpForConditionalGeneration |
| Voxtral |
mistralai/Voxtral-Mini-4B-Realtime-2602
mistralrs run -m mistralai/Voxtral-Mini-4B-Realtime-2602 |
VoxtralRealtimeForConditionalGeneration |