🔬 Einstein-v7-Qwen2-7B-GGUF

This is quantized version of Weyaxi/Einstein-v7-Qwen2-7B created using llama.cpp

Model Description

👁 image/png

This model is a full fine-tuned version of Qwen/Qwen2-7B on diverse datasets.

This model is finetuned using 8xMI300X using axolotl.

💬 Prompt Template

You can use ChatML prompt template while using the model:

ChatML

<|im_start|>system
{system}<|im_end|>
<|im_start|>user
{user}<|im_end|>
<|im_start|>assistant
{asistant}<|im_end|>

This prompt template is available as a chat template, which means you can format messages using the tokenizer.apply_chat_template() method:

messages = [
 {"role": "system", "content": "You are helpful AI asistant."},
 {"role": "user", "content": "Hello!"}
]
gen_input = tokenizer.apply_chat_template(message, return_tensors="pt")
model.generate(**gen_input)

📊 Datasets used in this model

The datasets used to train this model are listed in the metadata section of the model card.

Please note that certain datasets mentioned in the metadata may have undergone filtering based on various criteria.

The results of this filtering process and its outcomes are in a diffrent repository:

Weyaxi/sci-datasets/main

🎯 Open LLM Leaderboard Evaluation Results

🤖 Additional information about training

This model is full fine-tuned for 2 epoch.

Total number of steps was 500.

Base model

Qwen/Qwen2-7B

Weyaxi/Einstein-v7-Qwen2-7B

(8)