AVX-512's Enormous Advantage For AMD EPYC 4005 Series Performance
Intel's own OpenVINO AI toolkit is another notable AI workload very well optimized for AVX-512 (and AMX) on CPUs where supported... Sadly for the Xeon E-2400 and Xeon 6300 series, there is no AVX-512 and thus the EPYC 4005 processors winning by a landslide in performance and performance-per-Watt.
Even when AVX-512 was disabled it was interesting to see the EPYC 4005 processors still delivering better performance than the Xeon 6369P in a number of the benchmarks. The Xeon 6369P cores as a reminder are derived from Raptor Lake.
Microsoft's ONNX also ran exceptionally well on the AMD EPYC 4345P and 4585PX processors in relation to the Xeon 6369P.
