VOOZH about

URL: https://willitrunai.com/models/pixtral-12b

โ‡ฑ Pixtral 12B VRAM Requirements โ€” GPU Compatibility


๐Ÿ‘ Mistral AI
Mistral AI

Pixtral 12B

Current
๐Ÿ‘ huggingface
HuggingFace๐Ÿ‘ ollama
Ollama
5.6KDownloads689LikesSep 2024Released131K tokensContextApache 2.0License57 GoodQuality

Pixtral 12B (12B parameters) requires approximately 11.6 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 14 GB of VRAM.

Get started

โ€” copy & paste to run locally

Copy-paste commands to run Pixtral 12B on your machine.

Run

ollama run pixtral

Quick specs

Parameters12B
Architecturedense
Context131K tokens
Modalitytext+vision
Min RAM4.7 GB
Rec. RAM7.3 GB (Q4_K_M)
LicenseApache 2.0
FamilyPixtral
โœ“ Visionโœ“ Chat

About this model

The Pixtral-12B-2409 is a Multimodal Model of 12B parameters plus a 400M parameter vision encoder.

  • โ€ขNatively multimodal, trained with interleaved image and text data
  • โ€ข12B parameter Multimodal Decoder + 400M parameter Vision Encoder
  • โ€ขSupports variable image sizes
  • โ€ขLeading performance in its weight class on multimodal tasks
  • โ€ขMaintains state-of-the-art performance on text-only benchmarks

Related models

Your hardware

Detecting...

Quick picks

Best budgetA
RX 7600 XT 16GB~$329 โ€” 25 tok/s
๐Ÿ‘ NVIDIA
Best overallA
RTX 4080 Super 16GB~$999 โ€” 94 tok/s

Best hardware

Top picks for Pixtral 12B

RTX 4080 Super 16GBA
16 GB
RTX 5080 16GBA
16 GB
RTX 5080 Laptop 16GBA
16 GB
RTX 5070 Ti 16GBA
16 GB
RTX 4070 Ti Super 16GBA
16 GB

Run this model

Pixtral 12B on RTX 4080 Super 16GBPixtral 12B on RTX 5080 16GBPixtral 12B on RTX 5080 Laptop 16GB

Quantization options

VRAM estimates by quant level

No hardware detected โ€” fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
4.7 GB
Lowโ€”
Q3_K_S
3
5.9 GB
Lowโ€”
NVFP4
4
6.7 GB
Mediumโ€”
Q4_K_M
4
7.3 GB
Mediumโ€”
Q5_K_M
5
8.6 GB
Highโ€”
Q6_K
6
9.8 GB
Highโ€”
Q8_0
8
12.8 GB
Very Highโ€”
F16
16
24.6 GB
Maximumโ€”

Quality benchmarks

Pixtral 12B benchmark scores

Benchmark verified

Coding

SWE-bench Verifiedโ€”
HumanEval+72.0%
Aider Polyglotโ€”
LiveCodeBenchโ€”

General

Chatbot Arenaโ€”
IFEval61.3%

Source: official ยท 2024-09-17

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights7.3 GB
KV Cache2.4 GB
Runtime1.2 GB
Headroom0.6 GB

Frequently asked questions

FAQ โ€” Pixtral 12B

See also

Quantization GuideScoring MethodologyVRAM Calculator