👁 Mistral
Mistral
Mistral Small 4 119B
Frontier
Mistral Small 4 119B (119B parameters) requires approximately 79.5 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 6.5B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 92 GB of VRAM.
Get started
— copy & paste to run locallyCopy-paste commands to run Mistral Small 4 119B on your machine.
Run
lms load Mistral-Small-4-119B-2603 && lms server startQuick specs
About this model
- •MoE: 128 experts, 4 active
- •119B parameters: , with 6.5B activated per token
- •256k context length:
- •Multimodal input: Accepts both text and image input, with text output
- •Instruct and Reasoning functionalities: with function calls (reasoning effort configurable per request)
Related models
Your hardware
Detecting...
Quick picks
Best hardware
Top picks for Mistral Small 4 119B
Run this model
Quantization options
VRAM estimates by quant level
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 46.4 GB | Low | — |
Q3_K_S | 3 | 58.3 GB | Low | — |
NVFP4 | 4 | 66.6 GB | Medium | — |
Q4_K_M | 4 | 72.6 GB | Medium | — |
Q5_K_M | 5 | 85.7 GB | High | — |
Q6_K | 6 | 97.6 GB | High | — |
Q8_0 | 8 | 127.3 GB | Very High | — |
F16 | 16 | 244.0 GB | Maximum | — |
Quality benchmarks
Mistral Small 4 119B benchmark scores
Coding
Reasoning
Source: official · 2026-03-16
Hardware compatibility
Fit estimates across all hardware
Computing compatibility...
Memory breakdown
Reference: RTX 2060 6GB
Frequently asked questions
FAQ — Mistral Small 4 119B
See also