VOOZH about

URL: https://willitrunai.com/models/hf-nousresearch--hermes-4-3-36b-gguf

⇱ Hermes 4.3 36B VRAM Requirements — GPU Compatibility


NousResearch

Hermes 4.3 36B

Limited data available — some specs may be incomplete or estimated.
0K tokensContextUnknownLicense4 EntryQuality

Hermes 4.3 36B (36B parameters) requires approximately 28.0 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 33 GB of VRAM.

Quick specs

Parameters36B
Architecturedense
Context0K tokens
Modalitytext
Min RAM14 GB
Rec. RAM22 GB (Q4_K_M)
LicenseUnknown
FamilyUnknown
✓ Chat✓ Reasoning

Related models

Your hardware

Detecting...

Quick picks

Best budgetC
Mac mini M4 64GB~$1,099 — 7 tok/s
👁 NVIDIA
Best overallB
NVIDIA A100 40GB~$10,000 — 60 tok/s

Best hardware

Top picks for Hermes 4.3 36B

NVIDIA A100 40GBB
40 GB
RTX PRO 5000 Blackwell 48GBC
48 GB
RTX 6000 Ada 48GBC
48 GB
MacBook Pro M4 Max 64GBC
64 GB
NVIDIA L40S 48GBC
48 GB

Run this model

Hermes 4.3 36B on NVIDIA A100 40GBHermes 4.3 36B on RTX PRO 5000 Blackwell 48GBHermes 4.3 36B on RTX 6000 Ada 48GB

Quantization options

VRAM estimates by quant level

No hardware detected — fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
14.0 GB
Low
Q3_K_S
3
17.6 GB
Low
NVFP4
4
20.2 GB
Medium
Q4_K_M
4
22.0 GB
Medium
Q5_K_M
5
25.9 GB
High
Q6_K
6
29.5 GB
High
Q8_0
8
38.5 GB
Very High
F16
16
73.8 GB
Maximum

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights22.0 GB
KV Cache4.2 GB
Runtime1.2 GB
Headroom0.6 GB

Frequently asked questions

FAQ — Hermes 4.3 36B

See also

Quantization GuideScoring MethodologyVRAM Calculator