AMD EPYC 9845 Makes For A Persuasive Upgrade With Performance & Energy Efficiency

Written by Michael Larabel in Processors on 10 March 2025 at 10:30 AM EDT. Page 2 of 7. 8 Comments.

👁 OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. EPYC 9845 - acpi-cpufreq performance was the fastest.

Kicking off this benchmarking bout with OpenVINO for some AI coverage, the performance upgrade from Bergamo to Turin Dense while not going above the 400 Watt threshold was dramatic right away. The switch from EPYC 9754 to EPYC 9845 yielded 1.5x the performance with OpenVINO! That's for just 25% more cores and not even upgrading from the existing DDR5-4800 server memory. Just a BIOS upgrade and CPU swap to the existing Genoa/Bergamo 2U server platform.

👁 OpenVINO benchmark with settings of Model: Face Detection FP16-INT8, Device: CPU. EPYC 9845 - acpi-cpufreq performance was the fastest.

Even more of a kicker was that the EPYC 9845 was consuming significantly less power than the EPYC 9754. The AMD P-State and Power Profile tuning also paid off with dropping the CPU power consumption even more.

👁 OpenVINO benchmark with settings of Model: Age Gender Recognition Retail 0013 FP16-INT8, Device: CPU. EPYC 9845 was the fastest.

👁 OpenVINO benchmark with settings of Model: Age Gender Recognition Retail 0013 FP16-INT8, Device: CPU. EPYC 9754 was the fastest.

Helping out the EPYC 9845 deliver such superb OpenVINO AI performance is the full 512-bit data path found with the EPYC Zen 5 server processors. Switching to DDR5-6000/DDR5-6400 memory would also help in squeezing even more performance out of this existing server platform.

👁 OpenVINO benchmark with settings of Model: Face Detection Retail FP16-INT8, Device: CPU. EPYC 9845 was the fastest.

👁 OpenVINO benchmark with settings of Model: Face Detection Retail FP16-INT8, Device: CPU. EPYC 9845 - amd-pstate powersave, EPP power, Balanced Mem was the fastest.

The EPYC 9845 was consuming 81% the CPU power on average of the EPYC 9754 while engaging the amd-pstate powersave and EPP tuning led to 75% the power use of that Bergamo flagship while still achieving similar EPYC 9845 performance levels.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Llama-3.1-Tulu-3-8B-Q8_0, Test: Prompt Processing 512. EPYC 9845 - acpi-cpufreq performance was the fastest.

With Llama.cpp the EPYC 9845 was delivering 1.84x the performance of the EPYC 9754 prior generation processor while consuming less CPU power.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Llama-3.1-Tulu-3-8B-Q8_0, Test: Prompt Processing 512. EPYC 9845 - acpi-cpufreq performance was the fastest.

The reduced CPU power consumption also correlated to lower temperatures too on this AMD Titanite server.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: granite-3.0-3b-a800m-instruct-Q8_0, Test: Prompt Processing 2048. EPYC 9845 was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 2048. EPYC 9845 - acpi-cpufreq performance was the fastest.

The EPYC 9845 provides for a very heavy hitting upgrade path for existing EPYC 9004 servers (or other 400W TDP limited products) that top out at a 400 Watt TDP to achieve not only much greater performance but very meaningful efficiency improvements.

8 Comments - Next Page

Page: 1 2 3 4 5 6 7 Next Page

URL: https://www.phoronix.com/review/amd-epyc-9845/2

⇱ AMD EPYC 9845 Makes For A Persuasive Upgrade With Performance & Energy Efficiency Review - Phoronix

AMD EPYC 9845 Makes For A Persuasive Upgrade With Performance & Energy Efficiency