VOOZH about

URL: https://willitrunai.com/my-results/m2-ultra-64gb

⇱ Mac Studio M2 Ultra 64GB AI Tier List: 318 models ranked | WillItRunAI


AI Compatibility Tier List

Mac Studio M2 Ultra 64GB

374 AI models ranked by how well they run on your 64 GB unified memory hardware. Best match: Qwen 3.6 35B A3B (score: 98).

374

Models tested

318

Can run

64 GB

unified memory

59

Best tok/s

Tier Distribution

S 23
A 57
B 46
C 192
F 56
S: 23A: 57B: 46C: 192F: 56
S

S Tier -- Perfect Fit (23 models)

These models run flawlessly with headroom to spare.

πŸ‘ Alibaba
Qwen 3.6 35B A3B
S98
35B33.3 GB59 tok/s66K ctx
+1moe
πŸ‘ Alibaba
Qwen3-Coder 30B A3B Instruct
S97
30.5B27.9 GB70 tok/s215K ctx
moe
πŸ‘ Alibaba
Qwen 3.5 35B A3B
S97
35B30.6 GB64 tok/s131K ctx
moe
πŸ‘ Alibaba
Qwen3-VL 30B A3B Instruct
S96
30B27.6 GB73 tok/s218K ctx
moe
πŸ‘ Alibaba
Qwen 3 30B A3B
S95
30.5B27.9 GB70 tok/s131K ctx
moe
πŸ‘ Alibaba
Qwen 3.5 27B
S94
27B27.5 GB30 tok/s110K ctx
dense
S93
32B31.2 GB26 tok/s77K ctx
dense
πŸ‘ NVIDIA
Nemotron Cascade 2 30B A3B
S92
30B29.0 GB72 tok/s109K ctx
moe
πŸ‘ Mistral
Magistral Small 2507
S92
24B24.9 GB34 tok/s131K ctx
dense
πŸ‘ Alibaba
Qwen 3.6 27B
S92
27B25.3 GB23 tok/s262K ctx
+1dense
πŸ‘ Mistral
Devstral Small 2 24B Instruct
S92
24B24.9 GB34 tok/s155K ctx
dense
πŸ‘ NVIDIA
Nemotron 3 Nano 30B
S91
30B28.6 GB27 tok/s131K ctx
dense
πŸ‘ OpenAI
GPT-OSS 20B
S91
21B23.1 GB89 tok/s128K ctx
moe
πŸ‘ Alibaba
Qwen 3.5 9B
S91
9B15.5 GB91 tok/s131K ctx
dense
S90
14B18.8 GB59 tok/s131K ctx
dense
πŸ‘ Mistral
Devstral Small 1.1
S90
24B24.9 GB34 tok/s131K ctx
dense
πŸ‘ Microsoft
Phi-4-reasoning-plus 14B
S89
14.7B19.8 GB56 tok/s33K ctx
dense
πŸ‘ Google
Gemma 4 26B A4B
S89
25.2B26.8 GB75 tok/s100K ctx
moe
S89
8B14.9 GB102 tok/s131K ctx
dense
πŸ‘ LG AI
EXAONE 4.0 32B
S87
32B31.2 GB26 tok/s77K ctx
dense
πŸ‘ Alibaba
Qwen 3.5 4B
S86
4B12.4 GB56 tok/s131K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 32B
S86
32B31.2 GB26 tok/s77K ctx
dense
πŸ‘ Google
Gemma 4 31B
S86
30.7B41.2 GB20 tok/s21K ctx
dense
A

A Tier -- Great Fit (57 models)

Excellent performance with comfortable memory margins.

πŸ‘ Google
Gemma 3 27B
A85
27B35.5 GB22 tok/s31K ctx
dense
A85
32B31.2 GB26 tok/s4K ctx
dense
πŸ‘ IBM
Granite 4.1 30B
A84
30B30.0 GB27 tok/s82K ctx
dense
πŸ‘ Mistral
Mistral Small 3.2 24B
A84
24B24.9 GB34 tok/s131K ctx
vision
πŸ‘ Mistral
Ministral 3 14B
A84
14B18.8 GB58 tok/s195K ctx
multimodal
πŸ‘ Mistral
Codestral 2 25.08
A84
22B23.7 GB35 tok/s163K ctx
dense
πŸ‘ NVIDIA
Nemotron Nano 8B
A84
8B14.6 GB102 tok/s131K ctx
dense
24B24.9 GB34 tok/s131K ctx
dense
19B21.8 GB43 tok/s8K ctx
dense
πŸ‘ Microsoft
Phi-4 Mini Reasoning 4B
A83
3.8B11.6 GB53 tok/s131K ctx
dense
πŸ‘ Mistral
Mistral Small 24B
A82
24B24.9 GB34 tok/s33K ctx
dense
πŸ‘ Mistral AI
Mistral Small 3.1 24B
A82
24B24.9 GB34 tok/s131K ctx
dense
A81
14B19.4 GB58 tok/s16K ctx
dense
πŸ‘ InternLM
InternVL2 8B
A81
8B14.6 GB102 tok/s8K ctx
dense
πŸ‘ Moonshot AI
Kimi Linear 48B A3B
A81
48B38.0 GB16 tok/s155K ctx
linear
πŸ‘ Alibaba
Qwen 2.5 14B
A80
14B19.3 GB59 tok/s131K ctx
dense
πŸ‘ DeepSeek
DeepSeek Coder V2 16B
A80
16B20.9 GB113 tok/s131K ctx
moe
πŸ‘ Alibaba
Qwen 2.5 Coder 32B
A80
32B31.2 GB26 tok/s77K ctx
dense
πŸ‘ IBM
Granite Code 20B
A80
20B23.2 GB41 tok/s8K ctx
dense
πŸ‘ BigCode
StarCoder 15B
A80
15B33.3 GB44 tok/s8K ctx
dense
πŸ‘ IBM
Granite Code 34B
A79
34B32.2 GB24 tok/s8K ctx
dense
πŸ‘ Mistral
Ministral 3 8B
A79
8B14.9 GB102 tok/s243K ctx
multimodal
πŸ‘ OpenBMB
MiniCPM-V 2.6 8B
A79
8B14.6 GB102 tok/s2K ctx
dense
πŸ‘ Google
Gemma 3 12B
A79
12B20.0 GB50 tok/s101K ctx
dense
πŸ‘ NVIDIA
Nemotron Nano 9B v2
A79
9B15.7 GB91 tok/s131K ctx
dense
πŸ‘ Meta
CodeLlama 13B Instruct
A79
13B27.9 GB59 tok/s16K ctx
dense
πŸ‘ Cohere
Command R 35B
A78
35B31.6 GB24 tok/s111K ctx
dense
πŸ‘ Defog
SQLCoder 7B
A78
7B14.0 GB98 tok/s8K ctx
dense
πŸ‘ DeepSeek
DeepSeek R1 Distill 32B
A78
32B31.2 GB26 tok/s33K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 VL 7B
A77
7B12.9 GB98 tok/s33K ctx
dense
A77
4B12.4 GB56 tok/s33K ctx
dense
πŸ‘ LLaVA
LLaVA 1.6 13B
A77
13B27.9 GB59 tok/s4K ctx
dense
A76
7B14.0 GB98 tok/s8K ctx
dense
A76
9B13.9 GB92 tok/s131K ctx
dense
A76
13B18.2 GB63 tok/s33K ctx
dense
πŸ‘ Jina AI
Jina Embeddings v3
A76
0.57B10.9 GB8 tok/s8K ctx
dense
πŸ‘ Google
Gemma 4 E4B
A75
8B14.0 GB78 tok/s128K ctx
dense
A75
0.57B10.1 GB8 tok/s8K ctx
dense
πŸ‘ Meta
CodeLlama 7B Instruct
A74
7B19.9 GB98 tok/s16K ctx
dense
πŸ‘ Nous Research
Nous Dolphin 13B
A74
13B29.4 GB51 tok/s16K ctx
dense
πŸ‘ BigCode
StarCoder 7B
A74
7B19.4 GB98 tok/s8K ctx
dense
πŸ‘ Nous Research
Nous Hermes 1.0
A74
9B25.5 GB85 tok/s16K ctx
dense
πŸ‘ WizardLM
WizardLM 13B
A74
13B27.9 GB59 tok/s8K ctx
dense
πŸ‘ LMSYS
Vicuna 13B
A74
13B27.9 GB59 tok/s4K ctx
dense
πŸ‘ DeepSeek
DeepSeek R1 Distill 14B
A74
14B19.3 GB59 tok/s33K ctx
dense
πŸ‘ IBM
Granite Code 8B
A74
8B14.6 GB102 tok/s8K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 7B
A74
7B12.9 GB98 tok/s131K ctx
dense
A74
7B14.0 GB98 tok/s8K ctx
dense
πŸ‘ IBM
Granite 4.1 8B
A73
8B15.1 GB102 tok/s131K ctx
dense
πŸ‘ Mistral AI
Codestral Mamba 7B
A73
7B12.6 GB98 tok/s262K ctx
state-space
A73
12B17.6 GB68 tok/s131K ctx
dense
πŸ‘ Google
Gemma 2 27B
A72
27B35.5 GB22 tok/s8K ctx
dense
A72
7B19.9 GB98 tok/s8K ctx
dense
πŸ‘ InternLM
InternLM Chat 7B
A72
7B19.9 GB98 tok/s8K ctx
dense
πŸ‘ Mixedbread AI
mxbai Embed Large
A71
0.34B10.0 GB5 tok/s1K ctx
dense
πŸ‘ Snowflake
Snowflake Arctic Embed L
A71
0.34B10.0 GB5 tok/s1K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 Coder 3B
A71
3B11.8 GB42 tok/s131K ctx
dense
B

B Tier -- Good Fit (46 models)

Solid performance, may need quantization or reduced context.

πŸ‘ Baichuan
Baichuan 13B
B70
13B29.4 GB51 tok/s8K ctx
dense
B70
9B13.9 GB92 tok/s128K ctx
dense
πŸ‘ Meta
Llama 3.1 8B
B70
8B14.6 GB102 tok/s128K ctx
dense
7B15.0 GB98 tok/s8K ctx
dense
πŸ‘ Google
Gemma 4 E2B
B69
5.1B11.5 GB71 tok/s128K ctx
dense
πŸ‘ TII
Falcon 40B Instruct
B69
40B38.4 GB18 tok/s8K ctx
dense
πŸ‘ LLaVA
LLaVA 1.5 7B
B69
7B19.9 GB98 tok/s4K ctx
dense
πŸ‘ WizardLM
WizardMath 7B
B69
7B14.0 GB98 tok/s4K ctx
dense
B69
7B14.0 GB98 tok/s4K ctx
dense
πŸ‘ BAAI
BGE Large EN v1.5
B69
0.34B10.0 GB5 tok/s1K ctx
dense
πŸ‘ Cerebras
Cerebras-GPT 13B
B69
13B26.9 GB51 tok/s47K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 Coder 7B
B68
7B12.9 GB98 tok/s131K ctx
dense
πŸ‘ Google
Gemma 3 4B
B67
4B12.3 GB56 tok/s128K ctx
dense
πŸ‘ MosaicML
MPT-7B-Instruct
B67
7B19.9 GB98 tok/s8K ctx
dense
B67
7B19.9 GB98 tok/s8K ctx
dense
πŸ‘ Nomic AI
Nomic Embed Text v1.5
B67
0.14B8.6 GB2 tok/s8K ctx
dense
πŸ‘ Mistral
Ministral 3 3B
B67
3B10.4 GB42 tok/s262K ctx
multimodal
πŸ‘ Microsoft
Phi 4 Mini 4B
B66
4B11.7 GB56 tok/s128K ctx
dense
πŸ‘ Mistral
Mixtral 8x7B
B66
47B38.4 GB33 tok/s33K ctx
moe
πŸ‘ Alibaba
Qwen 3.5 2B
B65
2B10.7 GB28 tok/s131K ctx
dense
πŸ‘ DeepSeek
DeepSeek R1 Distill 8B
B65
8B14.6 GB102 tok/s33K ctx
dense
πŸ‘ 01.AI
Yi 1.5 34B
B65
34B32.2 GB24 tok/s4K ctx
dense
πŸ‘ DeepSeek
DeepSeek R1 Distill 7B
B65
7B12.9 GB98 tok/s33K ctx
dense
πŸ‘ Microsoft
Phi 3 Mini 3.8B
B65
3.8B16.0 GB53 tok/s98K ctx
dense
7B14.0 GB98 tok/s4K ctx
dense
πŸ‘ Google
Gemma 2 9B
B64
9B18.4 GB67 tok/s8K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 Coder 14B
B64
14B19.3 GB59 tok/s131K ctx
dense
πŸ‘ TII
Falcon 7B Instruct
B64
7B12.2 GB98 tok/s8K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 3B
B64
3B11.8 GB42 tok/s131K ctx
dense
πŸ‘ Microsoft
Phi 3.5 Mini 4B
B63
4B16.1 GB56 tok/s98K ctx
dense
πŸ‘ Meta
Llama 3.2 11B Vision
B63
11B16.5 GB74 tok/s16K ctx
vision
πŸ‘ Alibaba
Qwen 3 1.7B
B62
1.7B10.6 GB24 tok/s33K ctx
dense
πŸ‘ Mistral
Mistral Nemo 12B
B61
12B17.6 GB68 tok/s128K ctx
dense
πŸ‘ IBM
Granite 4.1 3B
B61
3B10.9 GB42 tok/s131K ctx
dense
0.02B8.1 GB2 tok/s0K ctx
dense
πŸ‘ IBM
Granite Code 3B
B61
3B12.1 GB42 tok/s8K ctx
dense
πŸ‘ 01.AI
Yi Coder 9B
B61
9B14.8 GB92 tok/s131K ctx
dense
πŸ‘ Mistral
Mistral 7B Instruct v0.3
B61
7B14.0 GB98 tok/s8K ctx
dense
πŸ‘ Microsoft
Phi 3 Medium 14B
B60
14B19.4 GB58 tok/s128K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 Coder 1.5B
B60
1.5B9.2 GB21 tok/s33K ctx
dense
πŸ‘ Mistral AI
Codestral 22B
B60
22B23.7 GB37 tok/s33K ctx
dense
πŸ‘ MosaicML
MPT-30B-Instruct
B59
30B52.8 GB18 tok/s8K ctx
dense
πŸ‘ InternLM
InternLM 20B
B58
20B40.5 GB33 tok/s8K ctx
dense
πŸ‘ Mistral
Ministral 8B
B58
8B14.9 GB102 tok/s131K ctx
dense
πŸ‘ Meta
Llama 3.2 3B
B57
3B11.4 GB42 tok/s128K ctx
dense
πŸ‘ Cohere
Aya Expanse 32B
B57
32B29.8 GB26 tok/s8K ctx
dense
C

C Tier -- Tight Fit (192 models)

Runs with offloading or significant compromises.

πŸ‘ 01.AI
Yi 34B Chat
C54
34B32.2 GB24 tok/s77K ctx
dense
πŸ‘ IBM
Granite 3.1 8B
C53
8B14.6 GB112 tok/s128K ctx
state-space
C53
9B14.8 GB92 tok/s4K ctx
dense
πŸ‘ Stability AI
StableLM 2 12B
C53
12B28.7 GB50 tok/s4K ctx
dense
πŸ‘ Unsloth
Qwen3.5 35B A3B
C53
35B33.3 GB22 tok/s66K ctx
dense
3B11.6 GB42 tok/s128K ctx
dense
Qwen3.5 35B A3B
C52
35B33.3 GB22 tok/s66K ctx
dense
πŸ‘ DeepSeek
DeepSeek R1 1.5B
C52
1.5B9.2 GB21 tok/s33K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 Math 7B
C52
7B12.9 GB98 tok/s4K ctx
dense
Hermes 4.3 36B
C52
36B34.0 GB21 tok/s62K ctx
dense
πŸ‘ TinyLlama
TinyLlama 1.1B
C52
1.1B8.8 GB15 tok/s4K ctx
dense
EXAONE 4.0 32B
C52
32B31.1 GB24 tok/s80K ctx
dense
aya expanse 32b heretic MPOA i1
C52
32B31.1 GB24 tok/s80K ctx
dense
C52
7B19.9 GB98 tok/s4K ctx
dense
Baichuan M2 32B Q4 K M
C52
32B31.1 GB24 tok/s80K ctx
dense
baichuan inc Baichuan M2 32B
C52
32B31.1 GB24 tok/s80K ctx
dense
πŸ‘ Unsloth
Qwen3.5 27B
C51
27B27.4 GB28 tok/s110K ctx
dense
πŸ‘ Unsloth
gemma 3 27b it
C51
27B27.4 GB28 tok/s110K ctx
dense
gemma 3 27b it
C51
27B27.4 GB28 tok/s110K ctx
dense
C50
7B14.0 GB98 tok/s8K ctx
dense
πŸ‘ BigCode
StarCoder2 15B
C50
15B19.8 GB48 tok/s16K ctx
dense
πŸ‘ Unsloth
Mistral Small 3.2 24B Instruct 2506
C50
24B25.3 GB32 tok/s134K ctx
dense
cognitivecomputations Dolphin Mistral 24B Venice Edition
C50
24B25.3 GB32 tok/s134K ctx
dense
Mistral Small 24B Instruct 2501
C50
24B25.3 GB32 tok/s134K ctx
dense
πŸ‘ Cohere
Aya Expanse 8B
C50
8B14.6 GB102 tok/s8K ctx
dense
mistral small 3.1 24b instruct 2503 hf
C50
24B25.3 GB32 tok/s134K ctx
dense
cognitivecomputations Dolphin3.0 R1 Mistral 24B
C50
24B25.3 GB32 tok/s134K ctx
dense
Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored i1
C50
24B25.3 GB32 tok/s134K ctx
dense
cognitivecomputations Dolphin Mistral 24B Venice Edition
C50
24B25.3 GB32 tok/s134K ctx
dense
Codestral 22B v0.1
C50
22B23.8 GB35 tok/s154K ctx
dense
Codestral 22B v0.1
C50
22B23.8 GB35 tok/s154K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 1.5B
C50
1.5B9.2 GB21 tok/s131K ctx
dense
Codestral 22B v0.1
C50
22B23.8 GB35 tok/s154K ctx
dense
Codestral 22B v0.1 IMat
C49
22B23.8 GB35 tok/s154K ctx
dense
8B14.6 GB102 tok/s33K ctx
dense
Codestral 22B v0.1 i1
C49
22B23.8 GB35 tok/s154K ctx
dense
πŸ‘ DeepSeek
DeepSeek LLM 7B
C49
7B19.4 GB98 tok/s4K ctx
dense
πŸ‘ Teknium
OpenHermes 2.5 7B
C49
7B14.0 GB98 tok/s8K ctx
dense
Codestral 21B Pruned i1
C49
21B23.1 GB36 tok/s166K ctx
dense
internlm2 5 20b chat
C49
20B22.4 GB38 tok/s178K ctx
dense
internlm2 limarp chat 20b
C49
20B22.4 GB38 tok/s178K ctx
dense
internlm2 math plus 20b i1
C49
20B22.4 GB38 tok/s178K ctx
dense
C49
7B14.0 GB98 tok/s33K ctx
dense
C49
9B14.4 GB85 tok/s497K ctx
dense
Codestral RAG 19B Pruned i1
C49
19B21.6 GB40 tok/s192K ctx
dense
Qwen3.5 9B Uncensored HauhauCS Aggressive
C49
9B14.4 GB85 tok/s497K ctx
dense
πŸ‘ Unsloth
DeepSeek R1 Distill Qwen 14B
C49
14B18.0 GB54 tok/s290K ctx
dense
πŸ‘ UC Berkeley
Starling LM 7B
C49
7B14.0 GB98 tok/s8K ctx
dense
Phi 4 reasoning vision 15B
C49
15B18.7 GB51 tok/s265K ctx
dense
Qwen3.5 9B
C49
9B14.4 GB85 tok/s497K ctx
dense
StarCoder2 15B
C49
15B18.7 GB51 tok/s265K ctx
dense
Meta Llama 3.1 8B Instruct
C49
8B13.6 GB95 tok/s570K ctx
dense
llava llama 3 8b v1 1
C48
8B13.6 GB95 tok/s570K ctx
dense
gemma 3 12b it
C48
12B16.5 GB63 tok/s352K ctx
dense
πŸ‘ Unsloth
DeepSeek R1 0528 Qwen3 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
NousResearch Hermes 4 14B
C48
14B18.0 GB54 tok/s290K ctx
dense
Meta Llama 3 8B Instruct
C48
8B13.6 GB95 tok/s570K ctx
dense
πŸ‘ Unsloth
DeepSeek R1 Distill Llama 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
Yi Coder 9B Chat
C48
9B14.4 GB85 tok/s497K ctx
dense
Dolphin3.0 Llama3.1 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
Llama 3 8B Instruct 32k v0.1
C48
8B13.6 GB95 tok/s570K ctx
dense
glm 4 9b chat 1m
C48
9B14.4 GB85 tok/s497K ctx
dense
Meta Llama 3.1 8B Instruct
C48
8B13.6 GB95 tok/s570K ctx
dense
vntl llama3 8b v2
C48
8B13.6 GB95 tok/s570K ctx
dense
starcoder2 15b instruct v0.1
C48
15B18.7 GB51 tok/s265K ctx
dense
DeepSeek R1 0528 Qwen3 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
starcoder2 15b i1
C48
15B18.7 GB51 tok/s265K ctx
dense
starcoder2 15b instruct v0.1
C48
15B18.7 GB51 tok/s265K ctx
dense
DeepSeek R1 0528 Qwen3 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
SOLAR 10.7B Instruct v1.0 uncensored
C48
10.7B15.6 GB71 tok/s405K ctx
dense
Nous Hermes 2 SOLAR 10.7B
C48
10.7B15.6 GB71 tok/s405K ctx
dense
Qwen3 8B DeepSeek v3.2 Speciale Distill
C48
8B13.6 GB95 tok/s570K ctx
dense
Yi 1.5 9B Chat
C48
9B14.4 GB85 tok/s497K ctx
dense
GGUF SOLARized GraniStral 14B 2102 YeAM HCT 32QKV
C48
14B18.0 GB54 tok/s290K ctx
dense
Hermes 3 Llama 3.1 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
HelpingAI 15B i1
C48
15B18.7 GB51 tok/s265K ctx
dense
Llama 2 7B Chat
C48
7B12.9 GB98 tok/s663K ctx
dense
internlm JanusCoder 14B
C48
14B18.0 GB54 tok/s290K ctx
dense
GGUF SOLARized GraniStral 14B 1902 YeAM HCT
C48
14B18.0 GB54 tok/s290K ctx
dense
Mistral 7B Instruct v0.2
C48
7B12.9 GB98 tok/s663K ctx
dense
Hermes 2 Pro Llama 3 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
Dolphin3.0 Llama3.1 8B
C48
8B13.6 GB95 tok/s570K ctx
dense
granite 8b code instruct 4k
C48
8B13.6 GB95 tok/s570K ctx
dense
Mistral 7B Instruct v0.3
C48
7B12.9 GB98 tok/s663K ctx
dense
dolphin 2.9.4 llama3.1 8b
C48
8B13.6 GB95 tok/s570K ctx
dense
Qwen3 48B A4B Savant Commander Distill 12X Closed Open Heretic Uncensored
C48
48B42.7 GB16 tok/s26K ctx
dense
openchat 3.6 8b 20240522 IMat
C48
8B13.6 GB95 tok/s570K ctx
dense
aya expanse 8b
C48
8B13.6 GB95 tok/s570K ctx
dense
Yi 9B Coder i1
C48
9B14.4 GB85 tok/s497K ctx
dense
solar finalised finetuned Model 10.7B i1
C48
10.7B15.6 GB71 tok/s405K ctx
dense
dolphin v2 8b abliterated i1
C48
8B13.6 GB95 tok/s570K ctx
dense
EXAONE 3.5 7.8B Instruct
C48
7.8B13.5 GB98 tok/s587K ctx
dense
πŸ‘ Google
Gemma 3 1B
C48
1B8.8 GB14 tok/s33K ctx
dense
SOLAR 10.7B v1.0
C48
10.7B15.6 GB71 tok/s405K ctx
dense
EXAONE 3.5 7.8B Instruct
C48
7.8B13.5 GB98 tok/s587K ctx
dense
HelpingAI2 9B
C48
9B14.4 GB85 tok/s497K ctx
dense
aya expanse 8b orthogonal heretic i1
C48
8B13.6 GB95 tok/s570K ctx
dense
EXAONE 3.5 7.8B Instruct i1
C48
7.8B13.5 GB98 tok/s587K ctx
dense
Mistral 7B Instruct v0.3
C48
7B12.9 GB98 tok/s663K ctx
dense
Hermes 2 Pro Mistral 7B
C48
7B12.9 GB98 tok/s663K ctx
dense
exaone 3.0 7.8b it
C48
7.8B13.5 GB98 tok/s587K ctx
dense
HelpingAI2 9B i1
C48
9B14.4 GB85 tok/s497K ctx
dense
HelpingAI 9B 200k i1
C48
9B14.4 GB85 tok/s497K ctx
dense
zephyr 7B beta
C48
7B12.9 GB98 tok/s663K ctx
dense
aya expanse 8b orthogonal heretic
C48
8B13.6 GB95 tok/s570K ctx
dense
Nous Hermes 2 Mistral 7B DPO
C48
7B12.9 GB98 tok/s663K ctx
dense
HelpingAI 9B i1
C48
9B14.4 GB85 tok/s497K ctx
dense
HelpingAI2.5 10B i1
C48
10B15.1 GB76 tok/s439K ctx
dense
Falcon H1R 7B
C48
7B12.9 GB98 tok/s663K ctx
dense
Helply 10.2b chat i1
C48
10.2B15.2 GB75 tok/s429K ctx
dense
falcon mamba 7b instruct Q4 K M
C48
7B12.9 GB98 tok/s663K ctx
dense
internlm2 5 1 8b chat i1
C48
8B13.6 GB95 tok/s570K ctx
dense
zephyr 7B alpha
C48
7B12.9 GB98 tok/s663K ctx
dense
speechless zephyr code functionary 7b
C48
7B12.9 GB98 tok/s663K ctx
dense
internlm3 8b instruct abliterated i1
C48
8B13.6 GB95 tok/s570K ctx
dense
πŸ‘ Google
Gemma 2 2B
C48
2B10.6 GB28 tok/s8K ctx
dense
StarCoder2 7B
C48
7B12.9 GB98 tok/s663K ctx
dense
japanese stablelm instruct gamma 7B
C48
7B12.9 GB98 tok/s663K ctx
dense
πŸ‘ Intel
Neural Chat 7B
C48
7B14.0 GB98 tok/s8K ctx
dense
Falcon H1 7B Instruct
C48
7B12.9 GB98 tok/s663K ctx
dense
πŸ‘ Unsloth
Falcon H1R 7B
C48
7B12.9 GB98 tok/s663K ctx
dense
Mamba Codestral 7B v0.1
C47
7B12.9 GB98 tok/s663K ctx
dense
stabilityai japanese stablelm base gamma 7b
C47
7B12.9 GB98 tok/s663K ctx
dense
baichuan2 7b chat
C47
7B12.9 GB98 tok/s663K ctx
dense
DiscoPOP zephyr 7b gemma
C47
7B12.9 GB98 tok/s663K ctx
dense
starcoder2 7b
C47
7B12.9 GB98 tok/s663K ctx
dense
zephyr 7b beta Mistral 7B Instruct v0.2
C47
7B12.9 GB98 tok/s663K ctx
dense
OpenChat 3.5 7B Qwen v2.0 i1
C47
7B12.9 GB98 tok/s663K ctx
dense
OpenChat 3.5 7B Starling v2.0 i1
C47
7B12.9 GB98 tok/s663K ctx
dense
internlm2 math plus 7b IMat
C47
7B12.9 GB98 tok/s663K ctx
dense
CodeNinja 1.0 OpenChat 7B i1
C47
7B12.9 GB98 tok/s663K ctx
dense
internlm2 5 7b chat i1
C47
7B12.9 GB98 tok/s663K ctx
dense
OpenSafetyLab MD Judge v0 2 internlm2 7b
C47
7B12.9 GB98 tok/s663K ctx
dense
MD Judge v0 2 internlm2 7b i1
C47
7B12.9 GB98 tok/s663K ctx
dense
Yi 1.5 6B Chat
C47
6B12.2 GB84 tok/s788K ctx
dense
zephyr 7b gemma sft african ultrachat 100k
C47
7B12.9 GB98 tok/s663K ctx
dense
jointpreferences mistral 7b sft helpful
C47
7B12.9 GB98 tok/s663K ctx
dense
zephyr 7b dpo full i1
C47
7B12.9 GB98 tok/s663K ctx
dense
blossom v3 baichuan2 7b i1
C47
7B12.9 GB98 tok/s663K ctx
dense
blossom v1 baichuan 7b i1
C47
7B12.9 GB98 tok/s663K ctx
dense
stablelm 2 zephyr 1 6b
C47
6B12.2 GB84 tok/s788K ctx
dense
C47
6B12.4 GB84 tok/s4K ctx
dense
Yi 1.5 6B Chat
C47
6B12.2 GB84 tok/s788K ctx
dense
stablelm 2 1 6b chat imatrix
C47
6B12.2 GB84 tok/s788K ctx
dense
πŸ‘ BigCode
StarCoder2 7B
C47
7B12.6 GB98 tok/s16K ctx
dense
HelpingAI2 6B
C47
6B12.2 GB84 tok/s788K ctx
dense
HelpingAI2 6B i1
C47
6B12.2 GB84 tok/s788K ctx
dense
πŸ‘ NVIDIA
Nemotron Mini 4B
C47
4B12.2 GB56 tok/s4K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 Coder 0.5B
C47
0.5B8.3 GB7 tok/s131K ctx
dense
HelpingAI2.5 5B i1
C46
5B11.4 GB70 tok/s962K ctx
dense
C46
4B10.7 GB56 tok/s1223K ctx
dense
gemma 3 4b it
C45
4B10.7 GB56 tok/s1223K ctx
dense
gemma 3 4b it
C45
4B10.7 GB56 tok/s1223K ctx
dense
πŸ‘ Alibaba
Qwen 3 0.6B
C45
0.6B9.0 GB8 tok/s33K ctx
dense
πŸ‘ Meta
Llama 3.2 1B
C45
1B8.9 GB14 tok/s128K ctx
dense
Llama 3.2 3B Instruct
C44
3B10.3 GB42 tok/s1643K ctx
dense
πŸ‘ Qwen
Qwen2.5 3B Instruct
C44
3B10.0 GB42 tok/s1658K ctx
dense
Llama 3.2 3B Instruct
C44
3B10.0 GB42 tok/s1658K ctx
dense
Ministral 3 3B Instruct 2512
C44
3B10.0 GB42 tok/s1658K ctx
dense
HELVETE 3B
C44
3B10.0 GB42 tok/s1658K ctx
dense
Hermes 3 Llama 3.2 3B
C44
3B10.0 GB42 tok/s1658K ctx
dense
stablelm zephyr 3b
C44
3B10.0 GB42 tok/s1658K ctx
dense
StarCoder2 3B
C44
3B10.0 GB42 tok/s1658K ctx
dense
AI21 Jamba Reasoning 3B
C44
3B10.0 GB42 tok/s1658K ctx
dense
stablelm 3b 4e1t
C44
3B10.0 GB42 tok/s1658K ctx
dense
ai21labs AI21 Jamba Reasoning 3B
C44
3B10.0 GB42 tok/s1658K ctx
dense
ai21labs AI21 Jamba2 3B
C44
3B10.0 GB42 tok/s1658K ctx
dense
HelpingAI 3B hindi i1
C43
3B10.0 GB42 tok/s1658K ctx
dense
AI21 Jamba2 3B
C43
3B10.0 GB42 tok/s1658K ctx
dense
HelpingAI 3B hindi
C43
3B10.0 GB42 tok/s1658K ctx
dense
AI21 Jamba2 3B i1
C43
3B10.0 GB42 tok/s1658K ctx
dense
gemma 2 2b it
C43
2B9.7 GB28 tok/s2500K ctx
dense
EXAONE 3.5 2.4B Instruct
C43
2.4B9.6 GB34 tok/s2094K ctx
dense
C43
2B9.3 GB28 tok/s2529K ctx
dense
Gemmasutra Mini 2B v1
C43
2B9.3 GB28 tok/s2529K ctx
dense
πŸ‘ BigCode
StarCoder2 3B
C43
3B10.1 GB42 tok/s16K ctx
dense
gemma 2 2b it
C42
2B9.3 GB28 tok/s2529K ctx
dense
πŸ‘ Alibaba
Qwen 3.5 0.6B
C42
0.6B9.0 GB8 tok/s131K ctx
dense
πŸ‘ Qwen
Qwen2.5 1.5B Instruct
C42
1.5B8.9 GB21 tok/s3400K ctx
dense
πŸ‘ Unsloth
DeepSeek R1 Distill Qwen 1.5B
C41
1.5B8.9 GB21 tok/s3400K ctx
dense
Yi Coder 1.5B Chat
C41
1.5B8.9 GB21 tok/s3400K ctx
dense
stablelm 2 zephyr 1.6b
C41
1.6B9.0 GB22 tok/s3182K ctx
dense
logos16v2 stablelm2 1.6b i1
C41
1.6B9.0 GB22 tok/s3182K ctx
dense
Yi Coder 1.5B
C41
1.5B8.9 GB21 tok/s3400K ctx
dense
πŸ‘ Unsloth
Falcon H1 1.5B Instruct
C41
1.5B8.9 GB21 tok/s3400K ctx
dense
πŸ‘ DeepSeek
DeepSeek LLM 67B
C41
67B54.5 GB10 tok/s4K ctx
dense
TinyLlama 1.1B Chat v1.0
C40
1.1B8.6 GB15 tok/s4667K ctx
dense
EXAONE 4.0 1.2B
C40
1.2B8.7 GB17 tok/s4271K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 0.5B
C40
0.5B8.3 GB7 tok/s131K ctx
dense
Llama 3.2 1B Instruct Q8 0
C40
1B8.7 GB14 tok/s5113K ctx
dense
TinyLlama 1.1B Chat v0.3
C40
1.1B8.6 GB15 tok/s4667K ctx
dense
πŸ‘ TinyLlama
TinyLlama 1.1B Chat v0.6
C40
1.1B8.6 GB15 tok/s4667K ctx
dense
F

F Tier -- Can't Run (56 models)

Too heavy for this hardware.

Llama 3.2 1B Instruct
D40
1B8.5 GB14 tok/s5142K ctx
dense
gemma 3 1b it
D40
1B8.5 GB14 tok/s5142K ctx
dense
TinyLlama 1.1B Chat v1.0 imatrix
D40
1.1B8.6 GB15 tok/s4667K ctx
dense
Falcon3 1B Instruct abliterated
D39
1B8.5 GB14 tok/s5142K ctx
dense
SmolVLM 500M Instruct
D38
0.5B8.3 GB7 tok/s6057K ctx
dense
embeddinggemma 300M
D36
0.3B8.2 GB4 tok/s6084K ctx
dense
granite embedding 107m multilingual
D34
0.11B8.0 GB2 tok/s6112K ctx
dense
Falcon H1 Tiny 90M Instruct
D34
0.09B8.0 GB2 tok/s6114K ctx
dense
πŸ‘ Meta
Llama 3.1 70B
F0
70B55.4 GB9 tok/s4K ctx
dense
πŸ‘ Meta
Llama 3.3 70B
F0
70B55.4 GB9 tok/s4K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 72B
F0
72B56.6 GB9 tok/s4K ctx
dense
πŸ‘ Alibaba
Qwen 3 235B A22B
F0
235B154.0 GB4 tok/s4K ctx
moe
πŸ‘ Alibaba
Qwen3-Coder-Next
F0
80B58.1 GB23 tok/s4K ctx
moe
πŸ‘ Alibaba
Qwen3-Coder 480B A35B Instruct
F0
480B303.5 GB3 tok/s4K ctx
moe
πŸ‘ Alibaba
Qwen 3.5 122B A10B
F0
122B84.7 GB14 tok/s4K ctx
moe
πŸ‘ Alibaba
Qwen 3.5 397B A17B
F0
397B252.9 GB4 tok/s4K ctx
moe
πŸ‘ Mistral
Mixtral 8x22B
F0
141B97.2 GB5 tok/s4K ctx
moe
πŸ‘ Mistral
Devstral 2 123B Instruct
F0
123B88.2 GB3 tok/s4K ctx
dense
πŸ‘ Mistral
Mistral Small 4 119B
F0
119B85.8 GB14 tok/s4K ctx
moe
πŸ‘ Mistral
Leanstral 119B A6B
F0
119B89.2 GB13 tok/s4K ctx
moe
πŸ‘ Mistral
Mistral Large 3
F0
675B424.9 GB3 tok/s4K ctx
+1moe
744B480.7 GB2 tok/s4K ctx
moe
F0
754B486.8 GB2 tok/s4K ctx
moe
1000B625.3 GB2 tok/s4K ctx
moe
1000B625.3 GB2 tok/s4K ctx
+1moe
πŸ‘ DeepSeek
DeepSeek V3 671B
F0
671B476.7 GB2 tok/s4K ctx
moe
πŸ‘ DeepSeek
DeepSeek V3.1 671B
F0
671B476.7 GB2 tok/s4K ctx
moe
πŸ‘ DeepSeek
DeepSeek V4 Pro
F0
1600B871.7 GB2 tok/s4K ctx
moe
πŸ‘ DeepSeek
DeepSeek V4 Flash
F0
284B167.1 GB7 tok/s4K ctx
moe
πŸ‘ DeepSeek
DeepSeek R1 671B
F0
671B476.7 GB2 tok/s4K ctx
moe
πŸ‘ DeepSeek
DeepSeek Coder V2 236B
F0
236B210.4 GB6 tok/s4K ctx
moe
πŸ‘ DeepSeek
DeepSeek V2.5 236B
F0
236B210.4 GB6 tok/s4K ctx
moe
πŸ‘ Meta
Llama 4 Scout 17B 16E
F0
109B77.2 GB9 tok/s4K ctx
moe
πŸ‘ Meta
Llama 4 Maverick 17B 128E
F0
400B254.7 GB4 tok/s4K ctx
moe
πŸ‘ Cohere
Command R+ 104B
F0
104B74.7 GB4 tok/s4K ctx
dense
πŸ‘ Cohere
Command A 111B
F0
111B79.4 GB4 tok/s4K ctx
dense
πŸ‘ Mistral AI
Pixtral Large 124B
F0
124B88.8 GB3 tok/s4K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 VL 72B
F0
72B56.6 GB9 tok/s4K ctx
dense
πŸ‘ Alibaba
Qwen 2.5 Math 72B
F0
72B56.6 GB9 tok/s4K ctx
dense
πŸ‘ NVIDIA
Nemotron 70B
F0
70B55.4 GB9 tok/s4K ctx
dense
πŸ‘ Meta
Llama 3.1 405B
F0
405B262.6 GB2 tok/s4K ctx
dense
πŸ‘ DeepSeek
DeepSeek R1 Distill 70B
F0
70B55.4 GB9 tok/s4K ctx
dense
πŸ‘ OpenAI
GPT-OSS 120B
F0
117B84.1 GB3 tok/s4K ctx
dense
πŸ‘ DeepSeek
DeepSeek V3.2
F0
671B417.6 GB3 tok/s4K ctx
moe
MiniMax M2.7
F0
230B151.9 GB8 tok/s4K ctx
moe
Solar Open 100B
F0
100B80.5 GB4 tok/s4K ctx
dense
K EXAONE 236B A23B
F0
236B179.4 GB2 tok/s4K ctx
dense
Llama 3.3 70B Instruct
F0
70B58.7 GB8 tok/s4K ctx
dense
Baichuan M3 235B
F0
235B178.7 GB2 tok/s4K ctx
dense
Baichuan M3 235B i1
F0
235B178.7 GB2 tok/s4K ctx
dense
BaichuanMed OCR 72B i1
F0
72B60.2 GB7 tok/s4K ctx
dense
Solar Open 100B i1
F0
100B80.5 GB4 tok/s4K ctx
dense
Solar Open 69B REAP i1
F0
69B58.0 GB8 tok/s4K ctx
dense
stabilityai japanese stablelm instruct beta 70b
F0
70B58.7 GB8 tok/s4K ctx
dense
πŸ‘ Unsloth
Qwen3.5 122B A10B
F0
122B81.9 GB4 tok/s4K ctx
dense
πŸ‘ Unsloth
Qwen3.5 397B A17B
F0
397B296.5 GB2 tok/s4K ctx
dense

Compare with...

See How Other Hardware Stacks Up

Check tier lists for similar GPUs and Apple Silicon configs

MacBook Pro M1 Max 64GB

64 GB unified memory

View tier list

MacBook Pro M3 Max 64GB

64 GB unified memory

View tier list

MacBook Pro M4 Max 64GB

64 GB unified memory

View tier list

MacBook Pro M4 Pro 64GB

64 GB unified memory

View tier list
Full Mac Studio M2 Ultra 64GB pageCompare this hardware