VOOZH about

URL: https://willitrunai.com/models/starcoder-15b

โ‡ฑ StarCoder 15B VRAM Requirements โ€” GPU Compatibility


๐Ÿ‘ BigCode
BigCode

StarCoder 15B

Legacy
๐Ÿ‘ huggingface
HuggingFace
21.7KDownloads3.0KLikesMay 2023Released8K tokensContextApache 2.0License60 GoodQuality

StarCoder 15B (15B parameters) requires approximately 27.2 GB of VRAM with Q5_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 32 GB of VRAM.

Get started

โ€” copy & paste to run locally

Copy-paste commands to run StarCoder 15B on your machine.

Run

lms load starcoder && lms server start

Quick specs

Parameters15B
Architecturedense
Context8K tokens
Modalitycode
Min RAM5.9 GB
Rec. RAM10.8 GB (Q5_K_M)
LicenseApache 2.0
FamilyStarCoder
โœ“ Codeโœ“ Reasoning

About this model

StarCoder 15B is BigCode's flagship code generation model trained on 1 trillion tokens from The Stack. Supports 80+ programming languages with 8K context and strong code completion capabilities.

Related models

Your hardware

Detecting...

Quick picks

Best budgetA
Mac mini M4 64GB~$1,099 โ€” 8 tok/s
๐Ÿ‘ NVIDIA
Best overallA
NVIDIA A100 40GB~$10,000 โ€” 123 tok/s

Best hardware

Top picks for StarCoder 15B

NVIDIA A100 40GBA
40 GB
RTX PRO 5000 Blackwell 48GBA
48 GB
RTX 6000 Ada 48GBA
48 GB
NVIDIA L40S 48GBA
48 GB
NVIDIA L40 48GBA
48 GB

Run this model

StarCoder 15B on NVIDIA A100 40GBStarCoder 15B on RTX PRO 5000 Blackwell 48GBStarCoder 15B on RTX 6000 Ada 48GB

Quantization options

VRAM estimates by quant level

No hardware detected โ€” fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
5.9 GB
Lowโ€”
Q3_K_S
3
7.4 GB
Lowโ€”
NVFP4
4
8.4 GB
Mediumโ€”
Q4_K_M
4
9.2 GB
Mediumโ€”
Q5_K_M
5
10.8 GB
Highโ€”
Q6_K
6
12.3 GB
Highโ€”
Q8_0
8
16.1 GB
Very Highโ€”
F16
16
30.7 GB
Maximumโ€”

Quality benchmarks

StarCoder 15B benchmark scores

Benchmark verified

Coding

SWE-bench Verifiedโ€”
HumanEval+33.6%
Aider Polyglotโ€”
LiveCodeBenchโ€”

Source: official ยท 2023-05-04

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights10.8 GB
KV Cache14.6 GB
Runtime1.2 GB
Headroom0.6 GB

Frequently asked questions

FAQ โ€” StarCoder 15B

See also

Quantization GuideScoring MethodologyVRAM Calculator