AMD 4th Gen EPYC 9654 "Genoa" AVX-512 Performance Analysis
Written by Michael Larabel in Processors on 19 December 2022 at 10:00 AM EST. Page 7 of 9. 65 Comments.
Moving back to more Intel software written to take advantage of AVX-512 that performs very well on AMD processors too... OpenVINO is up next for that wonderful open-source deep learning toolkit.
OpenVINO was commonly running at 2x the performance when AVX-512 was enabled, as is by default, for 4th Gen EPYC processors.
For some of the OpenVINO test cases there was higher power use with AVX-512 enabled runs, but still on a power efficiency basis was still being a positive net gain with Zen 4.
Microsoft's ONNX was also showing the benefit as well from Zen 4 AVX-512 use.