Can Yi 9B Coder i1 run on RX 7900 XTX 24GB?
YES — Runs Great
Yi 9B Coder i1 needs ~9.8 GB VRAM. RX 7900 XTX 24GB has 24.0 GB. With Q4_K_M quantization, expect ~126 tok/s.
Operating mode
Choose the run profile you care about
Interactive favors responsiveness, while light API and scale-out lean harder on serving readiness. The fit stays the same, but the recommendation lens changes.
Current mode
Balanced
Balanced for general local use. Keeps the ranking neutral across personal and serving workflows.
Select quantization to explore
Fit status
Runs well
Decode
125.9 tok/s
TTFT
1538 ms
Safe context
231K
Memory
9.8 GB / 24.0 GB
Memory breakdown
See how fast it feels
What limits this setup
This setup is broadly balanced for this model.
No major red flags
This recommendation has enough memory headroom and acceptable estimated speed for the selected workload.
Best improvement path
Performance by workload
| Workload | Grade | Fit | Decode | TTFT | Context |
|---|---|---|---|---|---|
| Chat | C | Runs well | 125.9 tok/s | 839 ms | 231K |
| Coding | C | Runs well | 125.9 tok/s | 1538 ms | 231K |
| Agentic Coding | C | Runs well | 125.9 tok/s | 2237 ms | 231K |
| Reasoning | C | Runs well | 125.9 tok/s | 1817 ms | 231K |
| RAG | C | Runs well | 125.9 tok/s | 2796 ms | 231K |
Quantization options
How Yi 9B Coder i1 (9B params) fits at each quantization level on RX 7900 XTX 24GB (24.0 GB usable).
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 3.5 GB | Low | C44 |
Q3_K_S | 3 | 4.4 GB | Low | C45 |
NVFP4 | 4 | 5.0 GB | Medium | C45 |
Q4_K_M | 4 | 5.5 GB | Medium | C45 |
Q5_K_M | 5 | 6.5 GB | High | C46 |
Q6_K | 6 | 7.4 GB | High | C47 |
Q8_0 | 8 | 9.6 GB | Very High | C48 |
F16Best for your GPU | 16 | 18.5 GB | Maximum | C49 |
Get started
Copy-paste commands to run Yi 9B Coder i1 on your machine.
Run
lms load hf-mradermacher--yi-9b-coder-i1-gguf && lms server start