Models that fit on common consumer hardware(8GiB VRAM). ~8-12B • 2 items • Updated • 1
Model Card for ConicCat/Role-mo-V2-7B
This model is a fine-tuned version of allenai/Olmo-3.1-32B-Instruct using humanline dpo to improve writing, roleplay, and chat capabilities.
Sampler Settings
- Chatml template
- I recommend .7 temp and (optionally) 1.05 rep pen.
Datasets
- nvidia/HelpSteer3 to maintain general capabilites and improve chat performance.
- ConicCat/Lamp-P-Prompted for improved prose and slop reduction.
- A C2 based human prompt / synthetic response roleplay preference dataset.
Changelog
- V0 > V1: Changed preference data construction to improve margins between the chosen and rejected responses.
- V1 > V2: More optimal hyperparameters; lowering lr and increasing bsz allows for stable training with lower beta.
- Downloads last month
- 5
Safetensors
Model size
7B params
Tensor type
BF16
·
Model tree for ConicCat/Role-mo-V2-7B
Base model
allenai/Olmo-3-1025-7B Finetuned
allenai/Olmo-3-7B-Instruct-SFT Finetuned
allenai/Olmo-3-7B-Instruct-DPO Finetuned
allenai/Olmo-3-7B-InstructQuantizations
2 models