Intel Xeon Max Sees Some Performance Gains For OpenVINO & ONNX With Linux 6.9
With Microsoft's ONNX Runtime there were some wins picked up on Linux 6.9.
With Llamafile and Llama.cpp there were some minor improvements too on the Linux 6.9 kernel.
Other workloads were commonly rather flat.
Of 236 benchmarks carried out in looking for any performance differences of Linux 6.8 vs. 6.9-rc2 for the Intel Xeon Max 2P Supermicro server, the 6.9-rc2 performance was level overall. The geo mean showed overall the performance was flat for Xeon Max on Linux 6.9 but in a few cases as noted there were some minor improvements to enjoy with this forthcoming kernel. The main workloads that seemed to have some benefits for Xeon Max on Linux 6.9 were ONNX Runtime and OpenVINO. Besides the performance, Linux 6.9 does bring many new features for server administrators and others to enjoy for this kernel that will be out as stable in May. These results weren't as exciting as the AMD EPYC Genoa-X benchmarks last week, but at least there weren't any major performance regressions besides an isolated oneDNN test case.
If you enjoyed this article consider joining Phoronix Premium to view this site ad-free, multi-page articles on a single page, and other benefits. PayPal or Stripe tips are also graciously accepted. Thanks for your support.