VOOZH about

URL: https://willitrunai.com/models/hf-mradermacher--baichuanmed-ocr-72b-i1-gguf

⇱ BaichuanMed OCR 72B i1 VRAM Requirements — GPU Compatibility


Mradermacher

BaichuanMed OCR 72B i1

Limited data available — some specs may be incomplete or estimated.
0K tokensContextUnknownLicense3 EntryQuality

BaichuanMed OCR 72B i1 (72B parameters) requires approximately 54.2 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 63 GB of VRAM.

Quick specs

Parameters72B
Architecturedense
Context0K tokens
Modalitytext
Min RAM28.1 GB
Rec. RAM43.9 GB (Q4_K_M)
LicenseUnknown
FamilyUnknown
✓ Chat

Related models

Your hardware

Detecting...

Quick picks

Best budgetC
MacBook Pro M3 Max 128GB~$2,499 — 6 tok/s
👁 NVIDIA
Best overallB
NVIDIA H100 80GB~$40,000 — 64 tok/s

Best hardware

Top picks for BaichuanMed OCR 72B i1

NVIDIA H100 80GBB
80 GB
NVIDIA GH200 96GBC
96 GB
NVIDIA H20 96GBC
96 GB
NVIDIA H800 80GBC
80 GB
NVIDIA A100 80GBC
80 GB

Run this model

BaichuanMed OCR 72B i1 on NVIDIA H100 80GBBaichuanMed OCR 72B i1 on NVIDIA GH200 96GBBaichuanMed OCR 72B i1 on NVIDIA H20 96GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
28.1 GB
Low
Q3_K_S
3
35.3 GB
Low
NVFP4
4
40.3 GB
Medium
Q4_K_M
4
43.9 GB
Medium
Q5_K_M
5
51.8 GB
High
Q6_K
6
59.0 GB
High
Q8_0
8
77.0 GB
Very High
F16
16
147.6 GB
Maximum

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights43.9 GB
KV Cache8.4 GB
Runtime1.2 GB
Headroom0.6 GB

Frequently asked questions

FAQ — BaichuanMed OCR 72B i1

See also

Quantization GuideScoring MethodologyVRAM Calculator