Voozh

VOOZH

URL: https://huggingface.co/TheBloke/OpenOrca_Stx-AWQ/blob/main/quant_config.json

⇱ quant_config.json · TheBloke/OpenOrca_Stx-AWQ at main

👁 TheBloke's picture

AWQ model commit

4aaa42c almost 3 years ago

Raw History Blame Contribute Delete

90 Bytes

{

"zero_point": true,

"q_group_size": 128,

"w_bit": 4,

"version": "GEMM"

}