exl2 quant (measurement.json in main branch)

check revisions for quants

A finetune of Mistral-7B-V0.3 to test out the Orion-Asstr dataset, This model was completion trained with Orion Asstr using Unsloth and then instruct-tuned with Gryphe's 20K Sonnetorca subset. The model leans towards RP format actions "Dialogue" and shorter responses.

Quants

GGUF : https://huggingface.co/Delta-Vector/Hamanasu-7B-instruct-gguf

EXL2 : https://huggingface.co/Delta-Vector/Hamanasu-7B-instruct-exl2

Prompting

Model has been tuned with the Mistral formatting. A typical input would look like this:

"""<s> [INST] Hello, how are you? [/INST] I'm doing great. How can I help you today?</s> [INST] I'd like to show off how chat templating works! [/INST]"""

System Prompting

I would highly recommend using either Euryale's system prompt or the EVA system prompt with the model.

Unsloth config

Credits

Thank you to Lucy Knada, jeiku, Intervitens, Kalomaze, Kubernetes Bad and the rest of Anthracite

Training

The training was done for 2 epochs. We used 1 x RTX A4000

👁 Made with Unsloth

Safety

Nein.

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for Delta-Vector/Hamanasu-7B-instruct-exl2

Base model

Delta-Vector/Hamanasu-7B-Base

Finetuned

(2)

this model

Datasets used to train Delta-Vector/Hamanasu-7B-instruct-exl2

Collection including Delta-Vector/Hamanasu-7B-instruct-exl2

A brand new series of Models from yours truly, Designed for Intelligence, Creativity and Roleplay - R/Locallama keeps DELETING MY GODDAMN COMMENTS • 25 items • Updated Mar 6 • 10

URL: https://huggingface.co/Delta-Vector/Hamanasu-7B-instruct-exl2

⇱ Delta-Vector/Hamanasu-7B-instruct-exl2 · Hugging Face