VOOZH about

URL: https://willitrunai.com/models/qwen-2.5-coder-1.5b

โ‡ฑ Qwen 2.5 Coder 1.5B VRAM Requirements โ€” GPU Compatibility


๐Ÿ‘ Alibaba
Alibaba

Qwen 2.5 Coder 1.5B

๐Ÿ‘ huggingface
HuggingFace๐Ÿ‘ ollama
Ollama
791.8KDownloads131LikesSep 2024Released33K tokensContextApache 2.0License46 BasicQuality

Qwen 2.5 Coder 1.5B (1.5B parameters) requires approximately 3.1 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 4 GB of VRAM.

Get started

โ€” copy & paste to run locally

Copy-paste commands to run Qwen 2.5 Coder 1.5B on your machine.

Run

ollama run qwen2.5-coder:1.5b

Quick specs

Parameters1.5B
Architecturedense
Context33K tokens
Modalitytext
Min RAM0.6 GB
Rec. RAM0.9 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
โœ“ Chat

About this model

Qwen 2.5 Coder 1.5B is Alibaba's compact code-specific language model from the Qwen2.5 Coder series. Trained on 5.5T tokens including source code, text-code grounding, and synthetic data. Features improvements in code generation, reasoning, and fixing while maintaining general and math capabilities.

  • โ€ขCode-specialized: trained on 5.5T tokens of code and text-code data
  • โ€ข28 layers with grouped-query attention (12 Q heads, 2 KV heads)
  • โ€ขStrong code generation, reasoning, and repair capabilities
  • โ€ขApache 2.0 license for unrestricted use

Related models

Your hardware

Detecting...

Quick picks

๐Ÿ‘ Intel
Best budgetB
Intel Arc A380 6GB~$139 โ€” 21 tok/s
๐Ÿ‘ NVIDIA
Best overallA
GTX 1650 4GB~$149 โ€” 21 tok/s

Best hardware

Top picks for Qwen 2.5 Coder 1.5B

GTX 1650 4GBA
4 GB
RTX 3050 Ti Laptop 4GBA
4 GB
Intel Arc A370M 4GBB
4 GB
RTX 2060 6GBB
6 GB
RTX 4050 Laptop 6GBB
6 GB

Run this model

Qwen 2.5 Coder 1.5B on GTX 1650 4GBQwen 2.5 Coder 1.5B on RTX 3050 Ti Laptop 4GBQwen 2.5 Coder 1.5B on Intel Arc A370M 4GB

Quantization options

VRAM estimates by quant level

No hardware detected โ€” fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
0.6 GB
Lowโ€”
Q3_K_S
3
0.7 GB
Lowโ€”
NVFP4
4
0.8 GB
Mediumโ€”
Q4_K_M
4
0.9 GB
Mediumโ€”
Q5_K_M
5
1.1 GB
Highโ€”
Q6_K
6
1.2 GB
Highโ€”
Q8_0
8
1.6 GB
Very Highโ€”
F16
16
3.1 GB
Maximumโ€”

Quality benchmarks

Qwen 2.5 Coder 1.5B benchmark scores

Benchmark verified

Coding

SWE-bench Verifiedโ€”
HumanEval+46.8%
Aider Polyglotโ€”
LiveCodeBenchโ€”

Source: community ยท 2024-09-17

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights0.9 GB
KV Cache0.4 GB
Runtime1.2 GB
Headroom0.6 GB

Frequently asked questions

FAQ โ€” Qwen 2.5 Coder 1.5B

See also

Quantization GuideScoring MethodologyVRAM Calculator