VOOZH about

URL: https://www.hardware-corner.net/gpu-llm-benchmarks/rtx-3080-ti/

⇱ RTX 3080 TI Local LLM Benchmarks, Context Scaling & Supported Models 2026 – Hardware Corner

Tier 1 Enthusiast

RTX 3080 Ti LLM Performance

Local LLM Performance: 52.2 t/s average on 14B models at 16k context. Updated Benchmarks: March 2026.

Gen (14B 4-bit) 52.2 t/s
PP (14B 4-bit) 1,774 t/s
Max Model 14B
VRAM
12 GB GDDR6X
Bandwidth 912 GB/s
Token Gen (14B @ 4k Ctx)

52.2T/s

Prompt Proc (14B @ 4k Ctx)

1,774T/s

Summary

In our 2026 analysis, we find the RTX 3080 Ti to be a frustratingly powerful card for local LLMs. While its raw compute and 912 GB/s bandwidth allowed us to blaze through token generation on smaller models like Qwen3 14B, the 12GB VRAM limit is a hard ceiling. We noticed that while it is incredibly fast, it simply cannot handle the larger models or deep context windows that some closely priced, higher-VRAM alternatives can. At current price, we find it difficult to recommend solely for LLMs unless you strictly stick to 8B-14B architectures.

Key Insights

Achieves impressive generation speeds of 52.3 t/s on Qwen3 14B (Q4_K) at 16k context.
High memory bandwidth (912 GB/s) yields excellent prompt processing at over 1,770 t/s.
Strictly limited to 14B parameter models and below due to the 12GB VRAM cap.
Handles Qwen3 8B effectively with context extension up to 32k tokens.

Current Price in US

$434

Avg. Market Value

Current Pricing

Hardware Specs
VRAM 12GB GDDR6X
Capable of running 14B model
Bandwidth 912 GB/s
Architecture Ampere
Memory speed 19 Gbps
Memory bus 384 bit
TDP 350 W
Suggested PSU 750 W
Price/GB VRAM $36.17
Price/(t/s) with 14B @ 16k $8.31

Biggest LLMs You Can Run on This GPU

The models below represent the largest language models that fit fully in VRAM on this GPU using 4-bit quantization (GGUF). Benchmarks include token generation and prompt processing speeds measured at their maximum supported context length.

Qwen3 14B (Q4_K) Max 16k
Token Generation 52.3 t/s @ 16k context
Prompt Processing 1,773.9 t/s @ 16k context
Qwen3 8B (Q4_K) Max 32k
Token Generation 68.1 t/s @ 32k context
Prompt Processing 1,761.2 t/s @ 32k context

Note: Context values are grouped into standard tiers (4K, 16K, 32K, 64K, 128K). Models may support slightly higher context, but they remain in the lower tier unless they reach the next bracket.

RTX 3080 Ti local LLM Inference Performance vs Similar GPUs

Compare prompt ingestion and token generation speeds against similar GPUs across widely used local models and extended context lengths up to 256K.

Local LLM Benchmarks

Prompt processing (t/s) and token generation speed (t/s) across different open weight models and context lengths.

Prompt Processing
Model 4k Ctx 16k Ctx 32k Ctx 64k Ctx 128k Ctx 256k Ctx
Qwen3 8B (Q4_K) 4,211.7 2,658.5 1,761.2 — — —
Qwen3 14B (Q4_K) 2,600.1 1,773.9 — — — —
Token Generation
Model 4k Ctx 16k Ctx 32k Ctx 64k Ctx 128k Ctx 256k Ctx
Qwen3 8B (Q4_K) 115.2 87.9 68.1 — — —
Qwen3 14B (Q4_K) 69.9 52.3 — — — —

Frequently Asked Questions

Common questions about running LLMs on the RTX 3080 Ti.