Overview

Moonlit-Mirage-12B was created through a multi-stage merge combining Stellar-Seraph-12B, Shining-Seraph-12B, Abyssal-Seraph-12B, Lunar-Nexus-12B, Moonlit-Shadow-12B, Lunar-Twilight-12B, Irix-12B-Model_Stock, Famino-12B-Model_Stock, and Celestial-Queen-12B.

Multi-stage merge configuration

name: First
models:
  - model: Vortex5/Stellar-Seraph-12B
  - model: Vortex5/Shining-Seraph-12B
  - model: Vortex5/Abyssal-Seraph-12B
merge_method: nexus
chat_template: auto
dtype: float32
tokenizer:
  source: Vortex5/Shining-Seraph-12B
---
name: Second
models:
  - model: Vortex5/Lunar-Nexus-12B
  - model: Vortex5/Moonlit-Shadow-12B
  - model: Vortex5/Lunar-Twilight-12B
merge_method: nexus
chat_template: auto
dtype: float32
tokenizer:
  source: Vortex5/Moonlit-Shadow-12B
---
name: Third
models:
  - model: DreadPoor/Irix-12B-Model_Stock
  - model: DreadPoor/Famino-12B-Model_Stock
  - model: Vortex5/Celestial-Queen-12B
merge_method: nexus
chat_template: auto
dtype: float32
tokenizer:
  source: Vortex5/Celestial-Queen-12B
---
models:
  - model: First
  - model: Second
  - model: Third
merge_method: nexus
chat_template: auto
dtype: float32
out_dtype: bfloat16
tokenizer:
  source: Vortex5/Moonlit-Shadow-12B