VOOZH about

URL: https://willitrunai.com/gpus/rx-7900-xt-20gb

⇱ AI Models for RX 7900 XT 20GB — What Runs on 20GB VRAM


AMD

RX 7900 XT 20GB

RX 7000ConsumerRDNA 3PCIe 4ROCm

Operating mode

Choose the operating mode for this hardware

Use this to bias workload recommendations toward responsiveness, background autonomy, lighter serving, or multi-GPU scale-out.

Current mode

Balanced

Balanced for general local use. Keeps the ranking neutral across personal and serving workflows.

See Full AI Tier List for RX 7900 XT 20GB →

About this GPU for AI

The RX 7900 XT 20GB is one of the high-end RDNA 3 consumer GPUs with official ROCm support. AMD lists it alongside the 7900 XTX as officially supported, meaning ROCm installers work without workarounds. The 20 GB of GDDR6 VRAM enables 13B models at FP16 and 34B+ models at Q4 — making it one of the most capable consumer AMD cards for local AI inference with a proper ROCm software stack.

Beyond LLMs

AI Capability Matrix

What AI tasks this GPU can handle — from text generation to image and video creation.

CapabilityStatusRepresentative ModelDetail
LLM Chat (7B)Runs nativelyLlama 3.1 8B Q4
LLM Coding (30B)Needs offloadQwen 3 30B Q4
rocm-supportedhigh-vramhigh-performance

Specifications

Compute
FP1652 TFLOPS
INT8416 TOPS
ArchitectureRDNA 3
Memory
VRAM20 GB
Bandwidth800 GB/s
TypeGDDR6
General
FamilyRX 7000
SegmentConsumer
InterconnectPCIe 4
Compute PlatformROCM
MSRP$899
TDP315W

Key Features

RDNA 3 architecture (Navi 31 die)20 GB GDDR6 on a 320-bit bus800 GB/s memory bandwidth84 Compute UnitsAMD Infinity Cache (96 MB L3)Official ROCm support (gfx1100 target)

For AI Workloads

Strengths
  • Official ROCm support — no workarounds needed for llama.cpp or PyTorch ROCm
  • 20 GB VRAM is rare at consumer prices, enabling large model inference
  • 800 GB/s bandwidth provides fast decode for generation throughput
  • Works with PyTorch ROCm, ONNX Runtime, and llama.cpp ROCm backend
Considerations
  • RDNA 3 ROCm ecosystem is less mature than NVIDIA CUDA
  • ROCm software stack is Linux-only — no Windows ROCm support
  • High TDP (315W) requires adequate case airflow and power supply
  • Some ML frameworks have incomplete ROCm kernels vs CUDA equivalents

Architecture

RDNA 3

RDNA 3 is AMD's chiplet-based GPU architecture, combining a 5nm Graphics Compute Die (GCD) with 6nm Memory Cache Dies (MCDs). It introduces AI accelerators and a new unified compute unit design.

AI Relevance

ROCm support for RDNA 3 is maturing but lags behind NVIDIA's CUDA ecosystem. AI accelerator units provide some inference acceleration, but lack the dedicated Tensor Core equivalent found in NVIDIA GPUs.

Process: TSMC 5nm + 6nmPlatform: ROCMPrecisions: FP32, FP16, BF16, INT8

Cost vs cloud API

8.6× cheaper than Claude Sonnet / GPT-4o per token

Assumes 4 hours/day of active inference at 61 tok/s, RX 7900 XT 20GB amortized over 36 months, US residential electricity ($0.15/kWh), blended cloud pricing at $10 per 1M tokens (GPT-4o / Claude Sonnet tier).

26.2M

Tokens/month at this pace

$30.6

Monthly local cost

$262

Same tokens on cloud API

$1.17

Local $/1M tokens

Break-even: pays for itself in 3.5 months vs cloud API at this workload. Price reference: $899 MSRP.

Recommendations by Workload

Chat

S

Qwen 3 14B

Qwen 3 14B matches Chat and keeps a practical fit profile. It is a recent-generation family, which helps on current local SOTA workloads. It fits natively with comfortable headroom. Context coverage stays within the requested workload envelope. Known distribution channels: huggingface, ollama, lm-studio.

Decode 60.7 tok/s · 56K ctx · llama.cppEST.
12.7 GB / 20.0 GB VRAM

Coding

S

Qwen 3.5 9B

Qwen 3.5 9B is a specialized fit for Coding. It is a recent-generation family, which helps on current local SOTA workloads. It fits natively with comfortable headroom. Context coverage stays within the requested workload envelope. Known distribution channels: huggingface, ollama, lm-studio.

Decode 73.4 tok/s · 71K ctx · llama.cppEST.
12.5 GB / 20.0 GB VRAM

Agentic Coding

S

Full Model Compatibility

👁 Alibaba
Qwen 3 14B
S96
14B13.9 GB61 tok/s56K ctx
dense
👁 Microsoft
Phi-4-reasoning-plus 14B
S95
14.7B14.9 GB58 tok/s33K ctx
dense
👁 Alibaba
Qwen 3.5 9B
S95

Just out of reach

Models you could run with an upgrade

High-quality models that need a bit more memory

Image & Video Generation

Diffusion Model Compatibility

39 of 52 models can generate images or video on your RX 7900 XT 20GB

ModelMax ResolutionGen TimeGrade
SD TurboImage512×512~1sS
Stable Diffusion 1.5Image512×768~2sS
Realistic Vision v5.1Image512×768~2sS
DreamShaper 8Image512×768~2sS
LCM DreamShaper v7

Upgrade paths

Upgrade from RX 7900 XT 20GB

See what you unlock with more powerful hardware

Upgrade options

Upgrade options

MacBook Pro M1 Max 32GBNext step up
32 GB Unified (+12)
A
Unlocks 17 additional models that do not fit on the current setup.Unlocks Qwen 3.5 35B A3B, Qwen 3 32B, EXAONE 4.0 32B+14 more

Unlocks 17 additional models that do not fit on the current setup.

~$2,499 MSRP

👁 Intel
Intel Arc Pro B60 24GBBest value
24 GB VRAM (+4)
A
Unlocks 22 additional models that do not fit on the current setup.Unlocks Qwen 3.6 35B A3B, Qwen 3.5 35B A3B, Qwen 3 32B+19 more

Unlocks 22 additional models that do not fit on the current setup.

~$599 MSRP

Radeon AI PRO R9700 32GBAMD upgrade
32 GB VRAM (+12)
A
Unlocks 28 additional models that do not fit on the current setup.Unlocks Qwen 3.6 35B A3B, Qwen 3.5 35B A3B, Qwen 3 32B+25 more

Unlocks 28 additional models that do not fit on the current setup.

~$1,899 MSRP

AMD Instinct MI350X 288GBBiggest leap
288 GB VRAM (+268)8000 GB/s (+7200)
B
Unlocks 67 additional models that do not fit on the current setup.Unlocks Qwen 3.5 397B A17B, Devstral 2 123B Instruct, Qwen 3.5 122B A10B+64 more · +139% faster avg

Unlocks 67 additional models that do not fit on the current setup.

Lifts average decode speed across fitting models by about 139%.

~$8,000 MSRP

Frequently Asked Questions

Compare with similar

RX 7900 XT 20GB vs RTX 4000 Ada 20GBRX 7900 XT 20GB vs RTX A4500 20GBRX 7900 XT 20GB vs RTX 3090 24GB

Related guides

What Can You Run on 16GB, 24GB, 32GB VRAM? — Local LLM Guide (April 2026)How Much VRAM Do You Need to Run LLMs Locally? (2026 Guide)
Compare this GPUCompare with another GPU →
20GB
VRAM
800GB/s
Bandwidth
52TFLOPS
FP16 Compute
416TOPS
INT8 Inference
315W TDP$899 MSRP
RX 7900 XT 20GBCategory AvgMacBook Pro M1 Max 32GB
LLM Large (70B)
Won’t fit
Llama 3.1 70B Q4
Image Gen (SDXL)Runs nativelySDXL 1.0 FP16~~8s per image
Image Gen (Flux)Very constrainedFlux.1 Dev FP16~~36s per image
Image Gen (SD 3.5)Tight fitSD 3.5 Large FP16~~43.9s per image
Video Short (25f)Runs nativelyLTX Video 2B~~20.8s/frame
Video Long (100f)Won't fitWan Video 14B~~20.4s/frame

Qwen 3.5 9B

Qwen 3.5 9B is a specialized fit for Agentic Coding. It is a recent-generation family, which helps on current local SOTA workloads. It fits natively with comfortable headroom. Context coverage stays within the requested workload envelope. Known distribution channels: huggingface, ollama, lm-studio.

Decode 73.4 tok/s · 71K ctx · llama.cppEST.
14.7 GB / 20.0 GB VRAM

Reasoning

S

Qwen 3 14B

Qwen 3 14B matches Reasoning and keeps a practical fit profile. It is a recent-generation family, which helps on current local SOTA workloads. It fits natively with comfortable headroom. Context coverage stays within the requested workload envelope. Known distribution channels: huggingface, ollama, lm-studio.

Decode 60.7 tok/s · 56K ctx · llama.cppEST.
13.9 GB / 20.0 GB VRAM

RAG

A

Granite 4.1 8B

Granite 4.1 8B matches RAG and keeps a practical fit profile. It sits in the middle of the current generation mix. It fits natively with comfortable headroom. Context coverage stays within the requested workload envelope. Known distribution channels: huggingface, ollama.

Decode 82.6 tok/s · 69K ctx · llama.cppEST.
14.3 GB / 20.0 GB VRAM
9B
10.6 GB
94 tok/s
85K ctx
dense
👁 Alibaba
Qwen 3 8B
S93
8B10.0 GB106 tok/s89K ctx
dense
👁 OpenAI
GPT-OSS 20B
S92
21B18.2 GB92 tok/s28K ctx
moe
👁 Mistral
Magistral Small 2507
S92
24B20.0 GB35 tok/s16K ctx
dense
👁 Mistral
Devstral Small 2 24B Instruct
S92
24B20.0 GB35 tok/s16K ctx
dense
👁 Alibaba
Qwen 3.6 27B
S91
27B20.3 GB17 tok/s10K ctx
+1dense
👁 Mistral
Ministral 3 14B
S90
14B13.9 GB60 tok/s56K ctx
multimodal
👁 Mistral
Devstral Small 1.1
S90
24B20.0 GB35 tok/s16K ctx
dense
👁 Alibaba
Qwen 3.5 4B
S88
4B7.5 GB56 tok/s107K ctx
dense
👁 NVIDIA
Nemotron Nano 8B
S87
8B9.7 GB106 tok/s100K ctx
dense
👁 Microsoft
Phi-4 Mini Reasoning 4B
A84
3.8B6.7 GB53 tok/s131K ctx
dense
👁 Alibaba
Qwen3-Coder 30B A3B Instruct
A84
30.5B23.0 GB41 tok/s4K ctx
moe
👁 Alibaba
Qwen3-VL 30B A3B Instruct
A84
30B22.7 GB43 tok/s4K ctx
moe
👁 Alibaba
Qwen 3 30B A3B
A82
30.5B23.0 GB41 tok/s4K ctx
moe
👁 Alibaba
Qwen 3.5 27B
A81
27B22.5 GB18 tok/s4K ctx
dense
👁 Jina AI
Jina Embeddings v3
A77
0.57B6.0 GB8 tok/s8K ctx
dense
👁 Google
Gemma 4 26B A4B
A77
25.2B21.9 GB48 tok/s8K ctx
moe
👁 BAAI
BGE M3
A76
0.57B5.2 GB8 tok/s8K ctx
dense
👁 NVIDIA
Nemotron 3 Nano 30B
A72
30B23.6 GB15 tok/s4K ctx
dense
👁 Alibaba
Qwen 3.5 397B A17B
F0
397B247.9 GB2 tok/s4K ctx
moe
👁 Mistral
Devstral 2 123B Instruct
F0
123B83.3 GB2 tok/s4K ctx
dense
👁 Moonshot AI
Kimi K2.5
F0
1000B620.3 GB2 tok/s4K ctx
moe
👁 Moonshot AI
Kimi K2.6
F0
1000B620.3 GB2 tok/s4K ctx
+1moe
👁 DeepSeek
DeepSeek V4 Pro
F0
1600B866.8 GB2 tok/s4K ctx
moe
👁 Alibaba
Qwen 3.5 122B A10B
F0
122B79.8 GB3 tok/s4K ctx
moe
👁 Alibaba
Qwen 3.6 35B A3B
F0
35B28.4 GB22 tok/s4K ctx
+1moe
👁 DeepSeek
DeepSeek V4 Flash
F0
284B162.2 GB2 tok/s4K ctx
moe
👁 Alibaba
Qwen 3.5 35B A3B
F0
35B25.7 GB29 tok/s4K ctx
moe
👁 Alibaba
Qwen 3 32B
F0
32B26.3 GB11 tok/s4K ctx
dense
👁 Mistral
Mistral Small 4 119B
F0
119B80.9 GB3 tok/s4K ctx
moe
👁 Cohere
Command A 111B
F0
111B74.5 GB2 tok/s4K ctx
dense
👁 Alibaba
Qwen 2.5 VL 72B
F0
72B51.7 GB2 tok/s4K ctx
dense
👁 OpenAI
GPT-OSS 120B
F0
117B79.2 GB2 tok/s4K ctx
dense
👁 Alibaba
Qwen3-Coder-Next
F0
80B53.2 GB5 tok/s4K ctx
moe
👁 Z.ai
GLM-5.1
F0
754B481.9 GB2 tok/s4K ctx
moe
👁 Mistral AI
Pixtral Large 124B
F0
124B83.9 GB2 tok/s4K ctx
dense
👁 Z.ai
GLM-5
F0
744B475.8 GB2 tok/s4K ctx
moe
👁 DeepSeek
DeepSeek V3.2
F0
671B412.7 GB2 tok/s4K ctx
moe
👁 Alibaba
Qwen 3 235B A22B
F0
235B149.1 GB2 tok/s4K ctx
moe
👁 Alibaba
Qwen3-Coder 480B A35B Instruct
F0
480B298.6 GB2 tok/s4K ctx
moe
👁 NVIDIA
Nemotron Cascade 2 30B A3B
F0
30B24.1 GB38 tok/s4K ctx
moe
👁 Google
Gemma 4 31B
F0
30.7B36.3 GB4 tok/s4K ctx
dense
MiniMax M2.7
F0
230B147.0 GB2 tok/s4K ctx
moe
👁 Mistral
Leanstral 119B A6B
F0
119B84.3 GB3 tok/s4K ctx
moe
👁 DeepSeek
DeepSeek Coder V2 236B
F0
236B205.5 GB2 tok/s4K ctx
moe
👁 DeepSeek
DeepSeek R1 671B
F0
671B471.8 GB2 tok/s4K ctx
moe
👁 DeepSeek
DeepSeek V3.1 671B
F0
671B471.8 GB2 tok/s4K ctx
moe
👁 LG AI
EXAONE 4.0 32B
F0
32B26.3 GB11 tok/s4K ctx
dense
Image
512×768
600ms
S
PixArt-SigmaImage1024×1024~8sS
FramePack I2VVideo256×256~14.7s/frameS
SDXL TurboImage512×512~1sS
SDXL LightningImage1024×1024~3sS
Stable Diffusion XL 1.0Image1024×1024~8sS
Playground v2.5Image1024×1024~12sS
RealVisXL v5.0Image1024×1024~9sS
DreamShaper XLImage1024×1024~9sS
Juggernaut XL v9Image1024×1024~9sS
Animagine XL 3.1Image1024×1024~9sS
Pony Diffusion V6 XLImage1024×1024~9sS
Animagine XL 4.0Image1024×1024~9sS
Illustrious XLImage1024×1024~9sS
Wan Video 2.1 1.3BVideo256×256~5.8s/frameS
Stable Diffusion 3.5 MediumImage1024×1024~14sS
Flux.2 Klein 4BImage1024×1024~2.4sS
LTX Video 2BVideo512×512~20.8s/frameS
KolorsImage1024×1024~16sS
Stable CascadeImage1024×1024~20sS
AuraFlow v0.3Image1536×1536~36sA
Stable Diffusion 3.5 LargeImage1024×1024~43.9sA
Stable Diffusion 3.5 Large TurboImage1024×1024~8sA
CogVideoX 2BVideo256×256~20.8s/frameB
HunyuanVideoVideo256×256~14.7s/frameB
ChromaImage256×256~8sB
Z-Image TurboImage256×256~16.5sB
Flux.1 DevImage256×256~36sD
Flux.1 SchnellImage256×256~7sD
LTX Video 13BVideo256×256~14.7s/frameD
Flux.1 Kontext DevImage256×256~39.9sD
AnimateDiff v1.5.3Video512×768~3.6s/frameD
Cosmos Diffusion 7BVideo256×256~22.1s/frameD
CogVideoX 5BVideo256×256~21s/frameD
Wan2.2 TI2V 5BVideo256×256~21s/frameD
Flux.2 Klein 9BImage256×256~4sF
Flux.1 Fill DevImage256×256~34sF
Mochi 1 PreviewVideo256×256~13.2s/frameF
HunyuanVideo 1.5Video256×256~12.3s/frameF
Helios 14BVideo256×256~15.1s/frameF
SkyReels V2 14BVideo256×256~15.1s/frameF
Wan Video 2.1 14BVideo256×256~15.1s/frameF
Wan Video 2.2 14BVideo256×256~15.1s/frameF
Qwen ImageImage256×256~13.5sF
Qwen Image EditImage256×256~13.5sF
Flux.2 DevImage256×256~6m 18sF
MAGI-1Video256×256~18.7s/frameF
HunyuanImage 3.0Image256×256~23.7sF

Image models estimated at 1024×1024 (28 steps, FP16). Video models estimated at 768×512 (25 frames, 30 steps, FP16). Actual performance varies with runtime and system load.

Buying advice

Should you buy RX 7900 XT 20GB for local AI?

Good for local AI

Handles 21 of 50 top models. Smaller and mid-size models run comfortably.

20.0 GB

VRAM

$899

MSRP

$45/GB

Cost per GB VRAM

Best models for this GPU

What will limit you first

This setup is broadly balanced for this model.

No major red flags

This recommendation has enough memory headroom and acceptable estimated speed for the selected workload.

Best upgrade itinerary

Unlocks 17 additional models that do not fit on the current setup.

Want more headroom? MacBook Pro M1 Max 32GB (32.0 GB unified memory) is the next step up.