Qwen3-30B-A3B-Thinking-2507-speculator.eagle3

Model Overview

• Verifier: Qwen3-30B-A3B
• Speculative Decoding Algorithm: EAGLE-3
• Model Architecture: Eagle3Speculator
• Release Date: 3/12/2026
• Version: 1.0
• Model Developers: RedHat

This model is a copy of RedHatAI/Qwen3-30B-A3B-speculator.eagle3. It can be used with Qwen/Qwen3-30B-A3B-Thinking-2507 as well.

This model is based on the EAGLE-3 speculative decoding algorithm. It was trained using the speculators library on a combination of the Magpie-Align/Magpie-Pro-300K-Filtered and the HuggingFaceH4/ultrachat_200k datasets. The model was trained with thinking enabled. This model should be used with the Qwen3-30B-A3B chat template, specifically through the /chat/completions endpoint.

Use with vLLM

vllm serve Qwen3-30B-A3B-Thinking-2507 \
 -tp 1 \
 --speculative-config '{
 "model": "RedHatAI/Qwen3-30B-A3B-Thinking-2507-speculator.eagle3",
 "num_speculative_tokens": 5,
 "method": "eagle3"
 }'

Evaluations

Model / run: Qwen3-30B-A3B-Thinking-2507-speculator.eagle3 (CKPT 5)
vLLM: 0.15.0
Training data: Magpie + UltraChat; responses from the Qwen/Qwen3-235B-A22B model (with reasoning enabled).

Acceptance lengths (draft length)