AMD EPYC 4545P Achieves 2.24x The Performance At Half The Power Of The First EPYC CPU

Written by Michael Larabel in Processors on 11 August 2025 at 09:10 AM EDT. Page 4 of 8. 9 Comments.

AVX-512 with AI workloads like PyTorch and LiteRT (formerly known as TensorFlow Lite) yields massive performance and power efficiency improvements with EPYC Zen 4 and newer processors. The EPYC 4545P processor far outpaced the original AMD EPYC Naples flagship processor.

👁 OpenVINO benchmark with settings of Model: Face Detection FP16, Device: CPU. EPYC 4545P was the fastest.

👁 OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. EPYC 4545P was the fastest.

👁 OpenVINO benchmark with settings of Model: Vehicle Detection FP16-INT8, Device: CPU. EPYC 4545P was the fastest.

👁 OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. EPYC 4545P was the fastest.

With the likes of the OpenVINO AI toolkit are some massive performance and power efficiency advantages even with the EPYC 4545P processor compared to the EPYC 7601 with twice as many cores and four times the number of memory channels.

👁 OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. EPYC 4545P was the fastest.

👁 OpenVINO benchmark with settings of Model: Face Detection Retail FP16-INT8, Device: CPU. EPYC 4545P was the fastest.

The EPYC 4545P with its 65 Watt TDP while delivering very nice performance thanks to Zen 5's AVX-512 implementation can make for some very nice edge AI use-cases with low-power CPU-based inferencing.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Llama-3.1-Tulu-3-8B-Q8_0, Test: Prompt Processing 512. EPYC 4545P was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: granite-3.0-3b-a800m-instruct-Q8_0, Test: Prompt Processing 512. EPYC 4545P was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 2048. EPYC 4545P was the fastest.

Very power efficient AI with Llama.cpp on the AMD EPYC 4545P.

9 Comments - Next Page

Page: 1 2 3 4 5 6 7 8 Next Page

URL: https://www.phoronix.com/review/amd-epyc-4545p-efficiency/4

⇱ AMD EPYC 4545P Achieves 2.24x The Performance At Half The Power Of The First EPYC CPU Review - Phoronix

AMD EPYC 4545P Achieves 2.24x The Performance At Half The Power Of The First EPYC CPU