Qwen3-235B-A22B-speculator

Model Overview

• Verifier: Qwen/Qwen3-235B-A22B
• Speculative Decoding Algorithm: EAGLE-3
• Model Architecture: Eagle3Speculator
• Release Date: 01/15/2026
• Version: 1.0
• Model Developers: RedHat

This is a speculator model designed for use with Qwen/Qwen3-235B-A22B, based on the EAGLE-3 speculative decoding algorithm. It was trained using the speculators library on a combination of the Magpie-Align/Magpie-Llama-3.1-Pro-300K-Filtered dataset and the train_sft split of the HuggingFaceH4/ultrachat_200k dataset. This model should be used with the Qwen/Qwen3-235B-A22B chat template, specifically through the /chat/completions endpoint. It was trained with thinking model on.

Use with vLLM

vllm serve Qwen/Qwen3-235B-A22B \
 -tp 8 \
 --speculative-config '{
 "model": "RedHatAI/Qwen3-235B-A22B-speculator.eagle3",
 "num_speculative_tokens": 3,
 "method": "eagle3"
 }'

Evaluations

Use cases

Acceptance lengths

Base model