Dell Pro Max GB10 vs. AMD Ryzen AI Max+ Framework Desktop For Llama.cpp, OpenCL & Vulkan Compute
Across all of the Llama.cpp benchmarks carried out, the AC system power consumption of the Dell Pro Max with GB10 was at 155 Watts on average and a recorded peak of 198 Watts and a minimum power draw of 39 Watts during the brief idle periods. The Framework Desktop with AMD Ryzen AI Max+ 395 meanwhile was at a 128 Watt average and 144 Watt peak but was able to idle lower at around 13 Watts.
When taking the geometric mean of all the Llama.cpp benchmarks carried out, the Dell Pro Max with GB10 was achieving 2.25x the performance of the AMD Ryzen AI Max+ 395 within the Framework Desktop. Quite a beating and even justifies the $4600 list price for the Dell Pro Max with GB10.
With the Dell Pro Max with GB10 being much smaller than the Framework Desktop and smaller heatsink, the GPU temperatures over the span of all the Llama.cpp runs were higher but not out of spec for this small form factor / mini PC.
Now for a look at some other OpenCL and Vulkan workloads for reference between these competing mini PCs...
