NVIDIA RTX PRO Blackwell Performance Delivering Excellent Linux Performance
A variety of models were tested with Llama.cpp using each GPU vendor's native back-end of NVIDIA CUDA / Intel oneAPI / AMD ROCm HIP (Vulkan Llama.cpp benchmarks follow). Both large and smaller models were tested for being able to retain coverage going down to the smaller graphics cards tested with their limited memory capacities.
The NVIDIA RTX PRO Blackwell graphics cards were delivering phenomenal performance both over the prior RTX PRO Ada Generation cards and against the Intel Arc Pro and AMD Radeon PRO offerings.
The NVIDIA RTX PRO 5000 Blackwell was outpacing the prior-gen flagship of the RTX 6000 Ada Generation. In fact, the RTX PRO 4500 Blackwell was even coming in close to the RTX 6000 Ada Generation performance in some of these AI benchmarks.
Meanwhile AMD's newest Radeon AI PRO R9700 performance was only competing with the RTX PRO 4000 Blackwell in these Llama.cpp benchmarks.
Intel's new Arc Pro B70 graphics card was coming up short of the RTX PRO 2000 Blackwell in these benchmarks.
Simply put, the NVIDIA RTX PRO Blackwell graphics cards were delivering incredible performance across the board with very nice generational gains each step of the way and coming well past where the AMD Radeon and Intel Arc Pro graphics cards can currently compete.
With every model tested under Llama.cpp, the NVIDIA RTX PRO Blackwell line-up was delivering incredible results.
