👁 image/png

🔬 Einstein-v6.1-Llama3-8B

This model is a full fine-tuned version of meta-llama/Meta-Llama-3-8B on diverse datasets.

This model is finetuned using 8xRTX3090 + 1xRTXA6000 using axolotl.

This model's training was sponsored by sablo.ai.

💬 Prompt Template

You can use ChatML prompt template while using the model:

ChatML

<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>

This prompt template is available as a chat template, which means you can format messages using the tokenizer.apply_chat_template() method:

messages = [
 {"role": "system", "content": "You are helpful AI asistant."},
 {"role": "user", "content": "Hello!"}
]
gen_input = tokenizer.apply_chat_template(message, return_tensors="pt")
model.generate(**gen_input)

📊 Datasets used in this model

The datasets used to train this model are listed in the metadata section of the model card.

Please note that certain datasets mentioned in the metadata may have undergone filtering based on various criteria.

The results of this filtering process and its outcomes are in the data folder of this repository:

Weyaxi/Einstein-v6.1-Llama3-8B/data

🔄 Quantizationed versions

GGUF @bartowski

• https://huggingface.co/bartowski/Einstein-v6.1-Llama3-8B-GGUF

ExLlamaV2 @bartowski

• https://huggingface.co/bartowski/Einstein-v6.1-Llama3-8B-exl2

AWQ @solidrust

• https://huggingface.co/solidrust/Einstein-v6.1-Llama3-8B-AWQ

🎯 Open LLM Leaderboard Evaluation Results

Detailed results can be found here

🎯 Open LLM Leaderboard v2 Evaluation Results

Detailed results can be found here

📚 Some resources, discussions and reviews aboout this model

🐦 Announcement tweet:

• https://twitter.com/Weyaxi/status/1783050724659675627

🔍 Reddit post in r/LocalLLaMA:

• https://www.reddit.com/r/LocalLLaMA/comments/1cdlym1/introducing_einstein_v61_based_on_the_new_llama3/

▶️ Youtube Video(s)

• Install Einstein v6.1 Llama3-8B Locally on Windows

📱 Octopus-V4-3B

• Octopus-V4-3B leverages the incredible physics capabilities of Einstein-v6.1-Llama3-8B in their model.

🤖 Additional information about training

This model is full fine-tuned for 2 epoch.

Total number of steps was 2026.

🤝 Acknowledgments

Thanks to sablo.ai for sponsoring this model.

Thanks to all the dataset authors mentioned in the datasets section.

Thanks to axolotl for making the repository I used to make this model.

Thanks to all open source AI community.

👁 Built with Axolotl

If you would like to support me:

☕ Buy Me a Coffee

Base model

meta-llama/Meta-Llama-3-8B

(599)

Einstein series • 11 items • Updated Dec 3, 2025 • 9