👁 Mistral
Mistral
Mistral Nemo 12B
Current
182.9KDownloads1.7KLikesJul 2024Released128K tokensContextApache 2.0License32 BasicQuality
Mistral Nemo 12B (12B parameters) requires approximately 11.6 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 14 GB of VRAM.
Get started
— copy & paste to run locallyCopy-paste commands to run Mistral Nemo 12B on your machine.
Run
ollama run mistral-nemoQuick specs
Parameters12B
Architecturedense
Context128K tokens
Modalitytext
Min RAM4.7 GB
Rec. RAM7.3 GB (Q4_K_M)
LicenseApache 2.0
FamilyMistral
✓ Chat
About this model
- •Released under the Apache 2 License
- •Pre-trained and instructed versions
- •Trained with a 128k context window
- •Trained on a large proportion of multilingual and code data
- •Drop-in replacement of Mistral 7B
Related models
Your hardware
Detecting...
Quick picks
Best hardware
Top picks for Mistral Nemo 12B
Run this model
Quantization options
VRAM estimates by quant level
No hardware detected — fit column shows raw VRAM estimates
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 4.7 GB | Low | — |
Q3_K_S | 3 | 5.9 GB | Low | — |
NVFP4 | 4 | 6.7 GB | Medium | — |
Q4_K_M | 4 | 7.3 GB | Medium | — |
Q5_K_M | 5 | 8.6 GB | High | — |
Q6_K | 6 | 9.8 GB | High | — |
Q8_0 | 8 | 12.8 GB | Very High | — |
F16 | 16 | 24.6 GB | Maximum | — |
Quality benchmarks
Mistral Nemo 12B benchmark scores
Reasoning
MMLU-Pro68.0%
GPQA Diamond5.4%
MATH-50012.7%
ARC Challenge—
General
Chatbot Arena—
IFEval63.8%
Source: official · 2024-07-18
Hardware compatibility
Fit estimates across all hardware
Computing compatibility...
Memory breakdown
Reference: RTX 2060 6GB
Weights7.3 GB
KV Cache2.4 GB
Runtime1.2 GB
Headroom0.6 GB
Frequently asked questions
FAQ — Mistral Nemo 12B
See also