Mistral Small 24B

Legacy

👁 huggingface
HuggingFace 👁 ollama
Ollama

53.0KDownloads960LikesJan 2025Released33K tokensContextMistral ResearchLicense75 StrongQuality

Mistral Small 24B (24B parameters) requires approximately 18.9 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 22 GB of VRAM.

Get started

— copy & paste to run locally

Copy-paste commands to run Mistral Small 24B on your machine.

Run

ollama run mistral-small

Quick specs

Parameters24B

Architecturedense

Context33K tokens

Modalitytext

Min RAM9.4 GB

Rec. RAM14.6 GB (Q4_K_M)

LicenseMistral Research

FamilyMistral Small

✓ Code✓ Chat

About this model

Mistral Small 3 ( 2501 ) sets a new benchmark in the "small" Large Language Models category below 70B, boasting 24B parameters and achieving state-of-the-art capabilities comparable to larger models! This model is an instruction-fine-tuned version of the base model: Mistral-Small-24B-Base-2501.

•Multilingual:: Supports dozens of languages, including English, French, German, Spanish, Italian, Chinese, Japanese, Korean, Portuguese, Dutch,...
•Agent-Centric:: Offers best-in-class agentic capabilities with native function calling and JSON outputting
•Advanced Reasoning:: State-of-the-art conversational and reasoning capabilities
•Apache 2.0 License:: Open license allowing usage and modification for both commercial and non-commercial purposes
•Context Window:: A 32k context window

Related models

Your hardware

Detecting...

Quick picks

👁 Intel

Best budgetA

Intel Arc Pro B60 24GB~$599 — 18 tok/s

👁 NVIDIA

Best overallS

RTX 5090 32GB~$1,999 — 88 tok/s

Best hardware

Top picks for Mistral Small 24B

👁 NVIDIA

RTX 5090 32GBS

32 GB

👁 NVIDIA

RTX PRO 4500 Blackwell 32GBS

32 GB

AMD Instinct MI100 32GBS

32 GB

👁 NVIDIA

NVIDIA V100 32GBS

32 GB

👁 NVIDIA

NVIDIA A100 40GBS

40 GB

Run this model

Mistral Small 24B on RTX 5090 32GB Mistral Small 24B on RTX PRO 4500 Blackwell 32GB Mistral Small 24B on AMD Instinct MI100 32GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	9.4 GB	Low	—
Q3_K_S	3	11.8 GB	Low	—
NVFP4	4	13.4 GB	Medium	—
Q4_K_M	4	14.6 GB	Medium	—
Q5_K_M	5	17.3 GB	High	—
Q6_K	6	19.7 GB	High	—
Q8_0	8	25.7 GB	Very High	—
F16	16	49.2 GB	Maximum	—

Quality benchmarks