VOOZH about

URL: https://willitrunai.com/models/gemma-2-27b

โ‡ฑ Gemma 2 27B VRAM Requirements โ€” GPU Compatibility


๐Ÿ‘ Google
Google

Gemma 2 27B

Current
๐Ÿ‘ huggingface
HuggingFace๐Ÿ‘ ollama
Ollama
32.5KDownloads568LikesJun 2024Released8K tokensContextGemmaLicense48 BasicQuality

Gemma 2 27B (27B parameters) requires approximately 29.5 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 34 GB of VRAM.

Get started

โ€” copy & paste to run locally

Copy-paste commands to run Gemma 2 27B on your machine.

Run

ollama run gemma2:27b

Quick specs

Parameters27B
Architecturedense
Context8K tokens
Modalitytext
Min RAM10.5 GB
Rec. RAM16.5 GB (Q4_K_M)
LicenseGemma
FamilyGemma
โœ“ Chatโœ“ Reasoning

About this model

Gemma 2 27B is Google's largest Gemma 2 model, offering state-of-the-art performance among open models of similar size. Built on Gemini technology with strong reasoning, code, and multilingual capabilities.

Related models

Your hardware

Detecting...

Quick picks

Best budgetB
Mac mini M4 64GB~$1,099 โ€” 7 tok/s
๐Ÿ‘ NVIDIA
Best overallA
RTX PRO 5000 Blackwell 48GB~$4,999 โ€” 72 tok/s

Best hardware

Top picks for Gemma 2 27B

RTX PRO 5000 Blackwell 48GBA
48 GB
NVIDIA A100 40GBA
40 GB
RTX 6000 Ada 48GBA
48 GB
NVIDIA L40S 48GBA
48 GB
NVIDIA L40 48GBA
48 GB

Run this model

Gemma 2 27B on RTX PRO 5000 Blackwell 48GBGemma 2 27B on NVIDIA A100 40GBGemma 2 27B on RTX 6000 Ada 48GB

Quantization options

VRAM estimates by quant level

No hardware detected โ€” fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
10.5 GB
Lowโ€”
Q3_K_S
3
13.2 GB
Lowโ€”
NVFP4
4
15.1 GB
Mediumโ€”
Q4_K_M
4
16.5 GB
Mediumโ€”
Q5_K_M
5
19.4 GB
Highโ€”
Q6_K
6
22.1 GB
Highโ€”
Q8_0
8
28.9 GB
Very Highโ€”
F16
16
55.4 GB
Maximumโ€”

Quality benchmarks

Gemma 2 27B benchmark scores

Benchmark verified

Coding

SWE-bench Verifiedโ€”
HumanEval+71.3%
Aider Polyglotโ€”
LiveCodeBenchโ€”

Reasoning

MMLU-Pro57.5%
GPQA Diamond16.7%
MATH-50050.1%
ARC Challenge71.4%

General

Chatbot Arenaโ€”
IFEval79.0%

Source: official ยท 2024-06-27

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights16.5 GB
KV Cache11.2 GB
Runtime1.2 GB
Headroom0.6 GB

Frequently asked questions

FAQ โ€” Gemma 2 27B

See also

Quantization GuideScoring MethodologyVRAM Calculator