👁 image/png

🔬 Einstein-v4-7B

This model is a full fine-tuned version of mistralai/Mistral-7B-v0.1 on diverse datasets.

This model is finetuned using 7xRTX3090 + 1xRTXA6000 using axolotl.

This model's training was sponsored by sablo.ai.

💬 Prompt Template

You can use this prompt template while using the model:

ChatML

<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>

This prompt template is available as a chat template, which means you can format messages using the tokenizer.apply_chat_template() method:

messages = [
 {"role": "system", "content": "You are helpful AI asistant."},
 {"role": "user", "content": "Hello!"}
]
gen_input = tokenizer.apply_chat_template(message, return_tensors="pt")
model.generate(**gen_input)

🔄 Quantizationed versions

Quantizationed versions of this model is available.

Exl2 @bartowski:

• https://huggingface.co/bartowski/Einstein-v4-7B-exl2

You can switch up branches in the repo to use the one you want

🎯 Open LLM Leaderboard Evaluation Results

Detailed results can be found here

🤖 Additional information about training

This model is full fine-tuned for 1.5 epoch.

Total number of steps was 1562.

🤝 Acknowledgments

Thanks to sablo.ai for sponsoring this model.

Thanks to all the dataset authors mentioned in the datasets section.

Thanks to axolotl for making the repository I used to make this model.

Thanks to all open source AI community.

👁 Built with Axolotl

If you would like to support me:

☕ Buy Me a Coffee

Base model