VOOZH

URL: https://www.phoronix.com/review/amd-epyc-4005-avx512/3

⇱ AVX-512's Enormous Advantage For AMD EPYC 4005 Series Performance Review - Phoronix

👁 Phoronix

Articles & Reviews
News Archive
Forums
Premium
Contact
Categories

Computers Display Drivers Graphics Cards Linux Gaming Memory Motherboards Processors Software Storage Operating Systems Peripherals

AVX-512's Enormous Advantage For AMD EPYC 4005 Series Performance

Written by Michael Larabel in Processors on 25 June 2025 at 03:00 PM EDT. Page 3 of 9. 44 Comments.

👁 LocalScore benchmark with settings of Model: Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Meta-Llama-3.1-8B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

With the LocalScore AI benchmark built atop Llama.cpp / Mozilla Llamafile there was tremendous benefit out of using AVX-512 as expected. Even without AVX-512, it was fascinating to see the EPYC 4345P still solidly outperforming the Xeon 6369P. As we've come to love out of the AVX-512 support on AMD Zen 4 and Zen 5 processors, there isn't the absurd power use as there was with AVX-512 during the early generations on the Intel side.

👁 LocalScore benchmark with settings of Model: Qwen2.5-14B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Qwen2.5-14B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Qwen2.5-14B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Qwen2.5-14B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

👁 LocalScore benchmark with settings of Model: Qwen2.5-14B-Instruct-Q4_K_M.gguf, Acceleration: CPU. EPYC 4585PX was the fastest.

With different (and larger) LLMs, the AVX-512 benefit of the AMD EPYC 4005 series continued to prove crystal clear compared to the Xeon 6300 series lacking AVX-512.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Llama-3.1-Tulu-3-8B-Q8_0, Test: Prompt Processing 512. EPYC 4585PX was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Llama-3.1-Tulu-3-8B-Q8_0, Test: Prompt Processing 512. EPYC 4585PX was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Llama-3.1-Tulu-3-8B-Q8_0, Test: Prompt Processing 512. EPYC 4585PX was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 512. EPYC 4585PX was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 512. EPYC 4585PX was the fastest.

👁 Llama.cpp benchmark with settings of Backend: CPU BLAS, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 512. EPYC 4585PX was the fastest.

For any AI inferencing at the edge or similar scenarios where the AMD EPYC 4005 series / Xeon 6300 series would be applicable, AMD easily wins hands-down for delivering much greater CPU-based inferencing performance and power efficiency thanks to AVX-512.

44 Comments - Next Page

Page: 1 2 3 4 5 6 7 8 9 Next Page

ARM Linux Server Performance Up More Than 7x Geo Mean In 8 Years, As Much As 15x With NVIDIA Vera CPU

AMD EPYC 8635P "Sorano" Benchmarks: Significant Upgrade Opportunity For EPYC 8004 Servers

Intel Xeon 6+ & Intel Ethernet E835 Launch

AMD Announces Radeon RX 9070 GRE, Ryzen AI Max PRO 400 Series

NVIDIA Vera CPU Benchmarks: Olympus Cores Delivering The Best Performance Ever Seen On ARM

Initial Benchmarks Of The SpacemiT K3 RVA23 RISC-V CPU With The K3 Pico-ITX

Support Phoronix
While Having Ad-Free Browsing,
Single-Page Article Viewing

Legal Disclaimer, Privacy Policy, Cookies | | Contact
Copyright © 2004 - 2026 by Phoronix Media.
All trademarks used are properties of their respective owners. All rights reserved.