21 items • Updated • 24
Model Overview
- Verifier: Qwen/Qwen3-VL-235B-A22B-Instruct
- Speculative Decoding Algorithm: EAGLE-3
- Model Architecture: Eagle3Speculator
- Release Date: 01/23/2026
- Version: 1.0
- Model Developers: RedHat
This is a speculator model designed for use with Qwen/Qwen3-VL-235B-A22B-Instruct, based on the EAGLE-3 speculative decoding algorithm.
It was trained using the speculators library on a combination of the Magpie-Align/Magpie-Llama-3.1-Pro-300K-Filtered dataset and the train_sft split of the HuggingFaceH4/ultrachat_200k dataset.
This model should be used with the Qwen/Qwen3-VL-235B-A22B-Instruct chat template, specifically through the /chat/completions endpoint.
Use with vLLM
vllm serve Qwen/Qwen3-VL-235B-A22B-Instruct \
-tp 8 \
--speculative-config '{
"model": "RedHatAI/Qwen3-VL-235B-A22B-Instruct-speculator.eagle3",
"num_speculative_tokens": 3,
"method": "eagle3"
}'
Evaluations
Use cases
| Use Case | Dataset | Number of Samples |
|---|---|---|
| Coding | HumanEval | 168 |
| Math Reasoning | gsm8k | 80 |
| Text Summarization | CNN/Daily Mail | 80 |
Acceptance lengths
| Use Case | k=1 | k=2 | k=3 | k=4 | k=5 |
|---|---|---|---|---|---|
| Coding | 1.85 | 2.49 | 2.88 | 3.13 | 3.24 |
| Math Reasoning | 1.85 | 2.54 | 2.96 | 3.25 | 3.24 |
| Text Summarization | 1.63 | 1.94 | 2.08 | 2.14 | 2.16 |
- Downloads last month
- 80
Safetensors
Model size
1B params
Tensor type
I64
·
BF16 ·
BOOL ·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for RedHatAI/Qwen3-VL-235B-A22B-Instruct-speculator.eagle3
Base model
Qwen/Qwen3-VL-235B-A22B-Instruct