merge

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DELLA merge method using marcuscedricridia/Cheng-2-Base as a base.

Models Merged

The following models were included in the merge:

• Cran-May/tempmotacilla-cinerea-0308

Configuration

The following YAML configuration was used to produce this model:

merge_method: della 
base_model: marcuscedricridia/Cheng-2-Base
models: 
 - model: Cran-May/tempmotacilla-cinerea-0308
 parameters: 
 density: 1 
 weight: 1 
 lambda: 0.9 
parameters: 
 density: 1 
 weight: 1 
 lambda: 0.9 
 normalize: true 
 int8_mask: true 
dtype: bfloat16 
tokenizer_source: base 
name: Cheng-2-Ingredient4