VOOZH about

URL: https://willitrunai.com/models/qwen-2.5-vl-72b

โ‡ฑ Qwen 2.5 VL 72B VRAM Requirements โ€” GPU Compatibility


๐Ÿ‘ Alibaba
Alibaba

Qwen 2.5 VL 72B

Frontier
๐Ÿ‘ huggingface
HuggingFace
479.0KDownloads630LikesJan 2025Released33K tokensContextApache 2.0License94 ExceptionalQuality

Qwen 2.5 VL 72B (72B parameters) requires approximately 50.3 GB of VRAM with Q4_K_M quantization. For the best balance of quality and speed, we recommend hardware with at least 58 GB of VRAM.

Get started

โ€” copy & paste to run locally

Copy-paste commands to run Qwen 2.5 VL 72B on your machine.

Run

lms load Qwen2.5-VL-72B-Instruct && lms server start

Quick specs

Parameters72B
Architecturedense
Context33K tokens
Modalitytext+vision
Min RAM28.1 GB
Rec. RAM43.9 GB (Q4_K_M)
LicenseApache 2.0
FamilyQwen
โœ“ Visionโœ“ Chatโœ“ Reasoning

About this model

license: other license_name: qwen license_link: https://huggingface.co/Qwen/Qwen2.5-VL-72B-Instruct/blob/main/LICENSE language: - en pipeline_tag: image-text-to-text tags: - multimodal library_name: transformers

  • โ€ขUnderstand things visually: Qwen2.5-VL is not only proficient in recognizing common objects such as flowers, birds, fish, and insects, but it is...
  • โ€ขBeing agentic: Qwen2.5-VL directly plays as a visual agent that can reason and dynamically direct tools, which is capable of computer use and...
  • โ€ขUnderstanding long videos and capturing events: Qwen2.5-VL can comprehend videos of over 1 hour, and this time it has a new ability of cpaturing...
  • โ€ขCapable of visual localization in different formats: Qwen2.5-VL can accurately localize objects in an image by generating bounding boxes or...
  • โ€ขGenerating structured outputs: for data like scans of invoices, forms, tables, etc. Qwen2.5-VL supports structured outputs of their contents,...

Related models

Your hardware

Detecting...

Quick picks

Best budgetS
MacBook Pro M4 Max 96GB~$2,499 โ€” 15 tok/s
๐Ÿ‘ NVIDIA
Best overallS
NVIDIA H100 80GB~$40,000 โ€” 70 tok/s

Best hardware

Top picks for Qwen 2.5 VL 72B

NVIDIA H100 80GBS
80 GB
NVIDIA H800 80GBS
80 GB
NVIDIA GH200 96GBS
96 GB
NVIDIA H20 96GBS
96 GB
NVIDIA A100 80GBS
80 GB

Run this model

Qwen 2.5 VL 72B on NVIDIA H100 80GBQwen 2.5 VL 72B on NVIDIA H800 80GBQwen 2.5 VL 72B on NVIDIA GH200 96GB

Quantization options

VRAM estimates by quant level

No hardware detected โ€” fit column shows raw VRAM estimates

QuantBitsVRAMQualityFit
Q2_K
2
28.1 GB
Lowโ€”
Q3_K_S
3
35.3 GB
Lowโ€”
NVFP4
4
40.3 GB
Mediumโ€”
Q4_K_M
4
43.9 GB
Mediumโ€”
Q5_K_M
5
51.8 GB
Highโ€”
Q6_K
6
59.0 GB
Highโ€”
Q8_0
8
77.0 GB
Very Highโ€”
F16
16
147.6 GB
Maximumโ€”

Quality benchmarks

Qwen 2.5 VL 72B benchmark scores

Benchmark verified

Reasoning

MMLU-Pro70.2%
GPQA Diamondโ€”
MATH-500โ€”
ARC Challengeโ€”

Source: community ยท 2025-01-26

Hardware compatibility

Fit estimates across all hardware

Open calculator

Computing compatibility...

Memory breakdown

Reference: RTX 2060 6GB

Weights43.9 GB
KV Cache4.9 GB
Runtime0.9 GB
Headroom0.6 GB

Frequently asked questions

FAQ โ€” Qwen 2.5 VL 72B

See also

Quantization GuideScoring MethodologyVRAM Calculator