VOOZH about

URL: https://huggingface.co/ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2

⇱ ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2 · Hugging Face

EXL2 Quants of Delta-Vector/Austral-24B-Winton

EXL2 quants of Delta-Vector/Austral-24B-Winton using exllamav2 for quantization.

Quants

Quant(Revision) Bits per Weight Head Bits
4.0_H6 4.0 6
4.5_H6 4.5 6

Downloading quants with huggingface-cli

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ArtusDev/Delta-Vector_Austral-24B-Winton-EXL2