AMD Ryzen AI Max+ 395 vs. Ryzen 9 9950X vs. Ryzen 9 9950X3D Linux Performance
Hitting these desktop processors first was Llama.cpp for some CPU-based AI inferencing. Interestingly for Llama.cpp the Framework Desktop with Ryzen AI Max+ 395 delivered a narrow lead over the Ryzen 9 9950X and 9950X3D processors. Part of the Ryzen AI Max+ 395 advantage here may be due to its LPDDR5-8000 memory feeding the Zen 5 cores. What was really astonishing was the CPU performance-per-Watt lead of Strix Halo.
In other Llama.cpp workloads the Ryzen AI Max+ 395 was delivering slightly better performance typically than the Ryzen 9 9950X / 9950X3D but really hitting a home run when it comes to power efficiency.
The Llama.cpp-powered LocalScore AI benchmark from Mozilla was also showing the Ryzen AI Max+ 395 performance comparable to the 9950X/9950X3D but with far greater power efficiency.
Meanwhile for Microsoft's ONNX Runtime the raw performance was trailing the Ryzen 9 9950X series desktop processors but with superior power efficiency.
