VOOZH about

URL: https://huggingface.co/Vortex5/Prototype-X-12b

⇱ Vortex5/Prototype-X-12b · Hugging Face


⚡ Prototype-X-12b ⚡

01 // Overview

Prototype-X-12b is a model merged using a custom flowforge method — it merges KansenSakura-Eclipse-RP-12B and KansenSakura-Radiance-RP-12B, with KansenSakura-Erosion-RP-12B as the base model.

02 // Custom Merge Method

It is a directional, coherence-aware merge algorithm that moves a base model along the weighted consensus direction defined by its donors rather than averaging them directly. Each donor’s influence is determined by its relative energy (the magnitude of its weight differences from the base), and the method normalizes and scales these offsets to preserve numerical stability. A small orthogonal adjustment prevents collapse when donors are highly similar, while the strength, trust, and top_k parameters control how far and how selectively the merge travels through parameter space. The result is a controlled shift in model behavior that reflects donor characteristics without discarding the base model’s underlying structure.

03 // Acknowledgments

Downloads last month
7
Safetensors
Model size
12B params
Tensor type
BF16
·

Model tree for Vortex5/Prototype-X-12b