VOOZH about

URL: https://www.phoronix.com/news/Intel-LLM-Scaler-vLLM-1.3

⇱ Intel Releases LLM-Scaler-vLLM 1.3 With New LLM Model Support - Phoronix


👁 Phoronix

Intel Releases LLM-Scaler-vLLM 1.3 With New LLM Model Support

Written by Michael Larabel in Intel on 30 January 2026 at 05:34 AM EST. Add A Comment
Intel today released the LLM-Scaler-vLLM 1.3 update with expanding the array of large language models that can run on Intel Arc Battlemage graphics cards with this Docker-based stack for deploying vLLM.

The new Intel llm-scaler-vllm 1.3 release via Docker and GitHub adds support for eight new models on capable Intel Arc Graphics hardware: Qwen3-Next-80B-A3B-Instruct, Qwen3-Next-80B-A3B-Thinking, InternVL3.5-30B-A3B, DeepSeek-OCR,PaddleOCR-VL, Seed-OSS-36B-Instruct, Qwen3-30B-A3B-Instruct-2507 and openai/whisper-large-v3.

In addition to those models, there is support for PaddleOCR models and GLM-4.6v-Flash support noted separately. There is also now sym_int4 support now for Qwen3-30B-A3B on TP 4/8 and Qwen3-235B-A22B on TP 16.

The LLM-Scaler-vLLM stack has upgraded against vLLM 0.11.1 and PyTorch 2.9. With the vLLM upgrade they have also enabled CPU KV cache offload, speculative decoding support with two more methods, experimental FP8 KV cache, and other enhancements.

Plus there are more bug fixes and other improvements with Intel LLM-Scaler-vLLM 1.3. Downloads and all the details via GitHub.

Michael Larabel is the principal author of Phoronix.com and founded the site in 2004 with a focus on enriching the Linux hardware experience. Michael has written more than 20,000 articles covering the state of Linux hardware support, Linux performance, graphics drivers, and other topics. Michael is also the lead developer of the Phoronix Test Suite, Phoromatic, and OpenBenchmarking.org automated benchmarking software. He can be followed via Twitter, LinkedIn, or contacted via MichaelLarabel.com.