VOOZH

URL: https://www.phoronix.com/review/intel-xeon-6-granite-rapids-amx/2

⇱ The Massive AI Performance Benefit With AMX On Intel Xeon 6 "Granite Rapids" - Phoronix

👁 Phoronix

Articles & Reviews
News Archive
Forums
Premium
Contact
Categories

Computers Display Drivers Graphics Cards Linux Gaming Memory Motherboards Processors Software Storage Operating Systems Peripherals

The Massive AI Performance Benefit With AMX On Intel Xeon 6 "Granite Rapids"

Written by Michael Larabel in Processors on 24 September 2025 at 10:20 AM EDT. Page 2 of 6. 15 Comments.

👁 OpenVINO benchmark with settings of Model: Face Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Face Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

AMX massively benefits the Intel Xeon 6 Granite Rapids performance for the OpenVINO AI toolkit.

👁 OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Person Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

Some of these gains were even more beneficial than the AMX comparison carried out two years ago with Sapphire Rapids. Now on Granite Rapids plus all of the software optimizations over the past two years.

👁 OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Vehicle Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

The total server power consumption for this dual Xeon 6980P server saw around 62 Watts higher power use with AMX enabled than when it was disabled. Not bad when it amounts to just a 4% increase overall and wasn't enough to throw off the CPU thermals. On a performance-per-Watt basis having AMX is still a significant win for that little increase in power usage.

👁 OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Road Segmentation ADAS FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Weld Porosity Detection FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. AMX Enabled - Default was the fastest.

👁 OpenVINO benchmark with settings of Model: Machine Translation EN To DE FP16, Device: CPU. AMX Enabled - Default was the fastest.

In some of the OpenVINO test cases there wasn't any significant power increase when comparing AMX enabled/disabled.

15 Comments - Next Page

Page: 1 2 3 4 5 6 Next Page

ARM Linux Server Performance Up More Than 7x Geo Mean In 8 Years, As Much As 15x With NVIDIA Vera CPU

AMD EPYC 8635P "Sorano" Benchmarks: Significant Upgrade Opportunity For EPYC 8004 Servers

Intel Xeon 6+ & Intel Ethernet E835 Launch

AMD Announces Radeon RX 9070 GRE, Ryzen AI Max PRO 400 Series

NVIDIA Vera CPU Benchmarks: Olympus Cores Delivering The Best Performance Ever Seen On ARM

Initial Benchmarks Of The SpacemiT K3 RVA23 RISC-V CPU With The K3 Pico-ITX

Support Phoronix
While Having Ad-Free Browsing,
Single-Page Article Viewing

Legal Disclaimer, Privacy Policy, Cookies | | Contact
Copyright © 2004 - 2026 by Phoronix Media.
All trademarks used are properties of their respective owners. All rights reserved.