Qwen3.6-35B-A3B-abliterated-MAX | APEX i-nano (2.72 BPW)

This model was quantized using apex-quant with the i-nano profile and an importance matrix calibrated on a diverse code/math/reasoning dataset.

Quantization Details

What is APEX Quantization?

APEX applies a per-layer, per-tensor quantization gradient _ higher precision on edge layers (first and last ~5), aggressive quantization on the middle layers, with separate handling for routed experts, shared experts, attention weights, and SSM weights. The i-nano variant uses importance matrix calibration to enable very low-bit formats (IQ2_S, IQ2_XXS) on middle-layer expert weights while preserving output quality.

Usage

Run with any recent llama.cpp build, no custom fork or patches required:

# CLI
./llama-cli -m Qwen3.6-35B-A3B-abliterated-MAX-APEX-i-nano.gguf -p "Your prompt here"

# Server
./llama-server -m Qwen3.6-35B-A3B-abliterated-MAX-APEX-i-nano.gguf--host 0.0.0.0 --port 8080

Files

Base model

Qwen/Qwen3.6-35B-A3B

prithivMLmods/Qwen3.6-35B-A3B-abliterated-MAX

(4)