Can Qwen 3 8B run on RTX 2080 Ti 11GB?
YES — Tight Fit
Qwen 3 8B needs ~9.4 GB VRAM. RTX 2080 Ti 11GB has 11.0 GB. With Q4_K_M quantization, expect ~82 tok/s.
Operating mode
Choose the run profile you care about
Interactive favors responsiveness, while light API and scale-out lean harder on serving readiness. The fit stays the same, but the recommendation lens changes.
Current mode
Balanced
Balanced for general local use. Keeps the ranking neutral across personal and serving workflows.
Select quantization to explore
Fit status
Tight fit
Decode
88.2 tok/s
TTFT
2195 ms
Safe context
28K
Memory
9.4 GB / 11.0 GB
Memory breakdown
See how fast it feels
What limits this setup
This setup is broadly balanced for this model.
Older PCIe generation
PCIe 3.0 is workable, but it compounds the penalty when you offload heavily or try to scale across multiple cards.
Best improvement path
Performance by workload
| Workload | Grade | Fit | Decode | TTFT | Context |
|---|---|---|---|---|---|
| Chat | S | Runs well | 88.2 tok/s | 1197 ms | 28K |
| Coding | S | Tight fit | 82.0 tok/s | 2360 ms | 28K |
| Agentic Coding | S | Runs with offload (needs ~0.2 GB host RAM) | 57.5 tok/s | 4895 ms | 28K |
| Reasoning | S | Tight fit | 88.2 tok/s | 2594 ms | 28K |
| RAG | S | Runs with offload (needs ~0.2 GB host RAM) | 57.5 tok/s | 6118 ms |
Quantization options
How Qwen 3 8B (8B params) fits at each quantization level on RTX 2080 Ti 11GB (11.0 GB usable).
| Quant | Bits | VRAM | Quality | Fit |
|---|---|---|---|---|
Q2_K | 2 | 3.1 GB | Low | S90 |
Q3_K_S | 3 | 3.9 GB | Low | S91 |
NVFP4 | 4 |
Get started
Copy-paste commands to run Qwen 3 8B on your machine.
Run
ollama run qwen3:8bYour hardware
More models your RTX 2080 Ti 11GB can run
| Model | Params | Grade | Decode | Capabilities |
|---|---|---|---|---|
| 👁 Alibaba Qwen 3.5 9B | 9B | S | 78.4 tok/s |
