The ReWiz series is based on a subset of data from 3 different data sets, which has been used for fine tuning. • 18 items • Updated • 1
👁 Image
Model Card for Model ID
Model Details
Model Description
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
- Developed by: theprint/Rasmus Rasmussen
- Funded by [optional]: No one
- Shared by [optional]: You?
Open LLM Leaderboard Evaluation Results
Detailed results can be found here
| Metric | Value |
|---|---|
| Avg. | 17.98 |
| IFEval (0-Shot) | 46.49 |
| BBH (3-Shot) | 19.29 |
| MATH Lvl 5 (4-Shot) | 9.74 |
| GPQA (0-shot) | 4.47 |
| MuSR (0-shot) | 6.94 |
| MMLU-PRO (5-shot) | 20.97 |
- Downloads last month
- 234
Safetensors
Model size
3B params
Tensor type
BF16
·
Model tree for theprint/ReWiz-Llama-3.2-3B
Base model
meta-llama/Llama-3.2-3B-Instruct Finetuned
unsloth/Llama-3.2-3B-InstructDatasets used to train theprint/ReWiz-Llama-3.2-3B
Space using theprint/ReWiz-Llama-3.2-3B 1
Collection including theprint/ReWiz-Llama-3.2-3B
Evaluation results
- strict accuracy on IFEval (0-Shot)Open LLM Leaderboard46.490
- normalized accuracy on BBH (3-Shot)Open LLM Leaderboard19.290
- exact match on MATH Lvl 5 (4-Shot)Open LLM Leaderboard9.740
- acc_norm on GPQA (0-shot)Open LLM Leaderboard4.470
- acc_norm on MuSR (0-shot)Open LLM Leaderboard6.940
- accuracy on MMLU-PRO (5-shot)test set Open LLM Leaderboard20.970