AMD Radeon AI PRO R9700 Linux Performance For Single & Dual GPU Benchmarks
With DeepSeek MOE 16b chat latency, the RTX 6000 Ada Generation had a narrow advantage over the dual Radeon AI PRO R9700 configuration tested.
When taking a look at all of the vLLM benchmarks that ran successfully on all of the graphics cards tested, the geo metric mean puts the dual Radeon AI PRO R9700 just ahead of the single NVIDIA RTX 6000 Ada Generation graphics card. But with two 300 Watt graphics card is at a disadvantage for power efficiency. The dual Radeon AI PRO R9700 though is competitive for pricing if the ~$1299 USD price holds. Even with two Radeon AI PRO R9700 for ~$2600, that is much less than the $5300+ still being commanded by the RTX 6000 Ada Generation graphics card. Plus with two R9700s is a combined 64GB of vRAM compared to 48GB with the RTX A6000. So on value, the AMD Radeon AI PRO R9700 can absolutely dominate -- assuming the prices hold as these graphics cards officially go on sale today. Again, unfortunately no RTX PRO Blackwell comparisons today due to not having received any review samples yet from NVIDIA.
Over the prior generation Radeon PRO W7900, the Radeon AI PRO R9700 was achieving 1.47x the performance of the W7900 which was a respectable showing especially considering the cut-down vRAM bandwidth and accelerator counts compared to that RDNA3 graphics card.
Both the Radeon AI PRO R9700 and RTX 6000 Ada Generation had a peak power consumption of around 300 Watts while the Radeon AI PRO R9700 had a 190 Watt average to the NVIDIA graphics card with a 223 Watt average.
The Radeon AI PRO R9700 was operating much cooler than both the Radeon PRO W7900 and RTX 6000 Ada Generation graphics cards.
Thanks to AMD for supplying the Radeon AI PRO R9700 review samples for Linux testing at Phoronix. The Radeon AI PRO R9700 is launching today with very nice out-of-the-box open-source and upstream Linux support and delivering a great experience atop ROCm 7.0. The real exciting aspect of the Radeon AI PRO R9700 is the compelling performance-per-dollar if the ~$1299 price holds.
For those curious about the AMD Radeon AI PRO R9700 for rendering workloads and other creator software and other non-AI GPU compute tasks, more Radeon AI PRO R9700 benchmarks will be coming in follow-up articles on Phoronix.
If you enjoyed this article consider joining Phoronix Premium to view this site ad-free, multi-page articles on a single page, and other benefits. PayPal or Stripe tips are also graciously accepted. Thanks for your support.