VOOZH about

URL: https://willitrunai.com/compare?a=m2-pro-16gb

⇱ Compare GPUs for Local AI — Side-by-Side Hardware Analysis | Will It Run AI


Compare

Compare local AI hardware with workload-aware output.

RTX 4090 24GB wins for coding in balanced mode

Based on model fit, speed, and quality across top recommendations.

MacBook Pro M2 Pro 16GB

ACodeGeeX 4 9B
llama.cppq4-k-mRuns well
8.7 GB / 11.5 GB
27.9 tok/s89K ctx
AGemma 4 E4B
llama.cppq4-k-mRuns well
8.8 GB / 11.5 GB
23.4 tok/s50K ctx
SQwen 3.5 9B
llama.cppq4-k-mTight fit
10.3 GB / 11.5 GB
27.4 tok/s25K ctx

Quick comparison

MetricMacBook Pro M2 Pro 16GBRTX 4090 24GB
Models that fit33
Avg decode tok/s26.237.9
Best grade score9293

Operating mode: Balanced. Balanced for general local use. Keeps the ranking neutral across personal and serving workflows.

RTX 4090 24GB

Winner
SCodestral 2 25.08
llama.cppq4-k-mRuns well
19.2 GB / 24.0 GB
42.0 tok/s48K ctx
SQwen 3.6 27B
llama.cppq4-k-mTight fit
20.7 GB / 24.0 GB
31.7 tok/s69K ctx
SDevstral Small 2 24B Instruct
llama.cppq4-k-mTight fit
20.4 GB / 24.0 GB
40.0 tok/s40K ctx