Compare
Compare local AI hardware with workload-aware output.
AMD Instinct MI300X 192GB wins for coding in balanced mode
Based on model fit, speed, and quality across top recommendations.
AMD Instinct MI300X 192GB
WinnerSDevstral 2 123B Instruct
llama.cppq6-kRuns well
126.3 GB / 192.0 GB
46.8 tok/s212K ctx
SQwen 3.5 122B A10B
llama.cppq6-kRuns well
122.6 GB / 192.0 GB
129.8 tok/s131K ctx
SMistral Small 4 119B
llama.cppq6-kRuns well
123.1 GB / 192.0 GB
140.8 tok/s221K ctx
Quick comparison
| Metric | AMD Instinct MI300X 192GB | RTX 4090 24GB |
|---|---|---|
| Models that fit | 3 | 3 |
| Avg decode tok/s | 105.8 | 37.9 |
| Best grade score | 98 | 93 |