Intel Arc B580 vs. AMD Radeon RX 9000 vs. NVIDIA RTX 50 Series For Llama.cpp Vulkan Performance

Written by Michael Larabel in Display Drivers on 8 December 2025 at 10:50 AM EST. Page 3 of 5. 11 Comments.

👁 Llama.cpp benchmark with settings of Backend: Vulkan, Model: granite-3.0-3b-a800m-instruct-Q8_0, Test: Text Generation 128. RTX 5090 was the fastest.

👁 Llama.cpp benchmark with settings of Backend: Vulkan, Model: granite-3.0-3b-a800m-instruct-Q8_0, Test: Prompt Processing 2048. RTX 5090 was the fastest.

With Granite 3.0 3B the NVIDIA graphics cards with Llama.cpp's Vulkan back-end were delivering much better performance than the Intel hardware on the ANV driver and the RDNA4 GPUs on RADV.

👁 Llama.cpp benchmark with settings of Backend: Vulkan, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Text Generation 128. RTX 5090 was the fastest.

👁 Llama.cpp benchmark with settings of Backend: Vulkan, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 512. RTX 5090 was the fastest.

👁 Llama.cpp benchmark with settings of Backend: Vulkan, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 1024. RTX 5090 was the fastest.

👁 Llama.cpp benchmark with settings of Backend: Vulkan, Model: Mistral-7B-Instruct-v0.3-Q8_0, Test: Prompt Processing 2048. RTX 5090 was the fastest.

The results aren't too surprising albeit useful having some fresh figures to share for those curious and satisfying a Phoronix Premium supporter's request.

11 Comments - Next Page

Page: 1 2 3 4 5 Next Page

URL: https://www.phoronix.com/review/llama-cpp-vulkan-eoy2025/3

⇱ Intel Arc B580 vs. AMD Radeon RX 9000 vs. NVIDIA RTX 50 Series For Llama.cpp Vulkan Performance - Phoronix

Intel Arc B580 vs. AMD Radeon RX 9000 vs. NVIDIA RTX 50 Series For Llama.cpp Vulkan Performance