DeepSeek V4 Flash

Frontier

2.0MDownloads1.6KLikesApr 2026Released1.0M tokensContextMITLicense98 ExceptionalQuality

DeepSeek V4 Flash (284B parameters) requires approximately 160.8 GB of VRAM with NVFP4 quantization. As a Mixture of Experts model with 13B active parameters, it uses less memory than its total parameter count suggests. For the best balance of quality and speed, we recommend hardware with at least 185 GB of VRAM.

Get started

— copy & paste to run locally

Copy-paste commands to run DeepSeek V4 Flash on your machine.

Run

docker run --rm -it ghcr.io/ggerganov/llama.cpp:full \
 --hf-repo "deepseek-ai/DeepSeek-V4-Flash" \
 --hf-file "DeepSeek-V4-Flash-NVFP4.gguf" \
 -c 4096 -ngl 99

Quick specs

Parameters284B (13B active)

Architecturemoe (MoE)

Context1.0M tokens

Modalitytext

Min RAM110.8 GB

Rec. RAM159 GB (NVFP4)

LicenseMIT

FamilyDeepSeek

✓ Code✓ Reasoning

About this model

DeepSeek V4 Flash is the lighter 284B-parameter sparse MoE sibling of V4 Pro (13B active, 256 routed + 1 shared expert) with the same 1M-token context. Experts ship natively in FP4, so the real on-disk footprint is roughly 158 GB rather than the FP16 size — it fits a single 192 GB unified-memory machine or a 2-4 GPU server while keeping near-frontier reasoning and coding quality.

•284B total / 13B active sparse MoE — 256 routed + 1 shared expert
•Native FP4 experts: ~158 GB on disk
•1M-token context with near-frontier coding quality
•Runs on a single 192 GB unified-memory box or a small GPU server

Related models

Your hardware

Detecting...

Quick picks

Best budgetS

AMD Instinct MI350X 288GB~$8,000 — 126 tok/s

Best overallS

AMD Instinct MI325X 256GB~$20,000 — 94 tok/s

Best hardware

Top picks for DeepSeek V4 Flash

AMD Instinct MI325X 256GBS

256 GB

AMD Instinct MI350X 288GBS

288 GB

👁 NVIDIA

NVIDIA B200 180GBS

180 GB

👁 NVIDIA

NVIDIA GB200 192GBS

192 GB

👁 NVIDIA

B100 192GBS

192 GB

Run this model

DeepSeek V4 Flash on AMD Instinct MI325X 256GB DeepSeek V4 Flash on AMD Instinct MI350X 288GB DeepSeek V4 Flash on NVIDIA B200 180GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

Quant	Bits	VRAM	Quality	Fit
Q2_K	2	110.8 GB	Low	—
Q3_K_S	3	139.2 GB	Low	—
NVFP4	4	159.0 GB	Medium	—
Q4_K_M	4	173.2 GB	Medium	—
Q5_K_M	5	204.5 GB	High	—
Q6_K	6	232.9 GB	High	—
Q8_0	8	303.9 GB	Very High	—
F16	16	582.2 GB	Maximum	—

Quality benchmarks