The Massive AI Performance Benefit With AMX On Intel Xeon 6 "Granite Rapids"

Written by Michael Larabel in Processors on 24 September 2025 at 10:20 AM EDT. Page 3 of 6. 15 Comments.

👁 OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16-INT8, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Person Vehicle Bike Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Noise Suppression Poconet-Like FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Handwritten English Recognition FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Person Re-Identification Retail FP16, Device: CPU. AMX Enabled - Default was the fastest.

For CPU-based AI inferencing, AMX is one of the most interesting features on the latest Intel Xeon server processors for vastly improving the performance and allowing the Intel server CPUs to compete with AMD EPYC 9005 "Turin" servers for CPU-based AI workloads.

15 Comments - Next Page

Page: 1 2 3 4 5 6 Next Page

URL: https://www.phoronix.com/review/intel-xeon-6-granite-rapids-amx/3

⇱ The Massive AI Performance Benefit With AMX On Intel Xeon 6 "Granite Rapids" - Phoronix

The Massive AI Performance Benefit With AMX On Intel Xeon 6 "Granite Rapids"