VOOZH about

URL: https://willitrunai.com/models/llama-4-scout-17b-16e

โ‡ฑ Llama 4 Scout 17B 16E VRAM Requirements โ€” GPU Compatibility


๐Ÿ‘ Meta
Meta

Llama 4 Scout 17B 16E

Frontier
๐Ÿ‘ huggingface
HuggingFace
729.0KDownloads1.3KLikesApr 2025Released10.5M tokensContextLlama 4 CommunityLicense66 GoodQuality

Llama 4 Scout 17B 16E (109B parameters) requires approximately 71.2 GB of VRAM with Q4_K_M quantization. As a Mixture of Experts model with 17B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 82 GB of VRAM.

Get started

โ€” copy & paste to run locally

Copy-paste commands to run Llama 4 Scout 17B 16E on your machine.

Run

lms load Llama-4-Scout-17B-16E-Instruct && lms server start

Quick specs

Parameters109B (17B active)
Architecturemoe (MoE)
Context10.5M tokens
Modalitytext+vision
Min RAM42.5 GB
Rec. RAM66.5 GB (Q4_K_M)
LicenseLlama 4 Community
FamilyLlama
โœ“ Visionโœ“ Chatโœ“ Reasoning

About this model

Llama 4 Scout is Meta's efficient Mixture-of-Experts model with 17B active parameters across 16 experts. Supports a 10M token context window and natively handles text, images, and video inputs.

Related models

Your hardware

Detecting...

Quick picks

Best budgetA
MacBook Pro M3 Max 128GB~$2,499 โ€” 9 tok/s
Best overallA
AMD Instinct MI250X 128GB~$15,000 โ€” 95 tok/s

Best hardware

Top picks for Llama 4 Scout 17B 16E

AMD Instinct MI250X 128GBA
128 GB
AMD Instinct MI300A 128GBA
128 GB
Gaudi 3 128GBA
128 GB
AMD Instinct MI250 128GBA
128 GB
Intel Data Center GPU Max 1550 128GBA
128 GB

Run this model

Llama 4 Scout 17B 16E on AMD Instinct MI250X 128GBLlama 4 Scout 17B 16E on AMD Instinct MI300A 128GBLlama 4 Scout 17B 16E on Gaudi 3 128GB

Quantization options

VRAM estimates by quant level

No hardware detected โ€” fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
42.5 GB
Lowโ€”
Q3_K_S
3
53.4 GB
Lowโ€”
NVFP4
4
61.0 GB
Mediumโ€”
Q4_K_M
4
66.5 GB
Mediumโ€”
Q5_K_M
5
78.5 GB
Highโ€”
Q6_K
6
89.4 GB
Highโ€”
Q8_0
8
116.6 GB
Very Highโ€”
F16
16
223.5 GB
Maximumโ€”

Quality benchmarks

Llama 4 Scout 17B 16E benchmark scores

Benchmark verified

Coding

SWE-bench Verifiedโ€”
HumanEval+โ€”
Aider Polyglotโ€”
LiveCodeBench32.8%

Reasoning

MMLU-Pro74.3%
GPQA Diamond57.2%
MATH-50050.3%
ARC Challengeโ€”

Source: official ยท 2025-04-05

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights66.5 GB
KV Cache2.9 GB
Runtime1.2 GB
Headroom0.6 GB

Frequently asked questions

FAQ โ€” Llama 4 Scout 17B 16E

See also

Quantization GuideScoring MethodologyVRAM Calculator