Vortex5/Crimson-Twilight-12B

Crimson Twilight 12B

01 // Overview

Crimson-Twilight-12B is a multistage merge designed for narrative roleplay.

Built with MergeKit.

02 // Merge Step 1

Abyssal-Seraph-12B merges with Lunar-Abyss-12B using nearswap (t=0.0008).

Show YAML

name: First
models:
  - model: Vortex5/Abyssal-Seraph-12B
merge_method: nearswap
base_model: Vortex5/Lunar-Abyss-12B
parameters:
  t: 0.0008
dtype: bfloat16

03 // Merge Step 2

Moonlit-Shadow-12B merges with Luminous-Shadow-12B via slerp (t=0.5).

Show YAML

name: Second
models:
  - model: Vortex5/Moonlit-Shadow-12B
merge_method: slerp
base_model: Vortex5/Luminous-Shadow-12B
parameters:
  t: 0.5
dtype: bfloat16

04 // Final Merge

The two intermediates are then merged via the Karcher mean method.

Show YAML

models:
  - model: First
  - model: Second
merge_method: karcher
dtype: bfloat16
parameters:
  tol: 1e-9
  max_iter: 35000
tokenizer:
  source: union
        

05 // Acknowledgments

• Team Mradermacher — Static & imatrix quantizations
• DeathGodlike — EXL3 quants