👁 image/png

🔬 Einstein-v4-7B

This model is a full fine-tuned version of mistralai/Mistral-7B-v0.1 on diverse datasets.

This model is finetuned using 7xRTX3090 + 1xRTXA6000 using axolotl.

This model's training was sponsored by sablo.ai.

💬 Prompt Template

You can use this prompt template while using the model:

ChatML

<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>

This prompt template is available as a chat template, which means you can format messages using the tokenizer.apply_chat_template() method:

messages = [
 {"role": "system", "content": "You are helpful AI asistant."},
 {"role": "user", "content": "Hello!"}
]
gen_input = tokenizer.apply_chat_template(message, return_tensors="pt")
model.generate(**gen_input)

🔄 Quantizationed versions

Quantizationed versions of this model is available.

GGUF @LoneStriker

• https://huggingface.co/LoneStriker/Einstein-v4-7B-GGUF

AWQ @solidrust

• https://huggingface.co/solidrust/Einstein-v4-7B-AWQ

Exl2 @bartowski:

• https://huggingface.co/bartowski/Einstein-v4-7B-exl2

🎯 Open LLM Leaderboard Evaluation Results

Detailed results can be found here

🎯 Open LLM Leaderboard v2 Evaluation Results

Detailed results can be found here

📚 Some resources, discussions and reviews aboout this model

🐦 Announcement tweet:

https://twitter.com/Weyaxi/status/1765851433448944125

🔍 Reddit post in r/LocalLLaMA:

• https://www.reddit.com/r/LocalLLaMA/comments/1b9gmvl/meet_einsteinv47b_mistralbased_sft_model_using/

▶️ Youtube Videos

• https://www.youtube.com/watch?v=-3YWgHJIORE&t=18s

• https://www.youtube.com/watch?v=Xo2ySU8gja0

🤖 Additional information about training

This model is full fine-tuned for 1.5 epoch.

Total number of steps was 1562.

🤝 Acknowledgments

Thanks to sablo.ai for sponsoring this model.

Thanks to all the dataset authors mentioned in the datasets section.

Thanks to axolotl for making the repository I used to make this model.

Thanks to all open source AI community.

👁 Built with Axolotl

If you would like to support me:

☕ Buy Me a Coffee

Base model

mistralai/Mistral-7B-v0.1

(936)

Einstein series • 11 items • Updated Dec 3, 2025 • 9