Quantized versions of models by mistralai • 19 items • Updated • 6
QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF
This is quantized version of munish0838/Mistral-v0.3-Instruct-Matter-Slim-A created using llama.cpp
Model Description
- Developed by: munish0838
- License: apache-2.0
- Finetuned from model : unsloth/mistral-7b-instruct-v0.3-bnb-4bit
- Dataset Used: 0-hero/Matter-0.1-Slim-A
This mistral model was trained 2x faster with Unsloth and Huggingface's TRL library.
- Downloads last month
- 108
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to add your hardware
3-bit
4-bit
Model tree for QuantFactory/Mistral-v0.3-Instruct-Matter-Slim-A-GGUF
Base model
mistralai/Mistral-7B-v0.3 Finetuned
mistralai/Mistral-7B-Instruct-v0.3