Hollowed-Rose-12B

Overview

Hollowed-Rose-12B is a multi-stage merge using the following models: Captain-Eris_Violet-V0.420-12B, Scarlet-Ink-12B, Sunlit-Shadow-12B, and Hollow-Aether-12B.

Show YAML Config

name: First
models:
  - model: Nitral-AI/Captain-Eris_Violet-V0.420-12B
merge_method: nearswap
base_model: Vortex5/Scarlet-Ink-12B
parameters:
  t: 0.0008
dtype: bfloat16
tokenizer:
  source: Vortex5/Scarlet-Ink-12B
---
name: Second
models:
  - model: Vortex5/Sunlit-Shadow-12B
merge_method: nearswap
base_model: Vortex5/Hollow-Aether-12B
parameters:
  t: 0.0008
dtype: bfloat16
---
models:
  - model: First
  - model: Second
merge_method: karcher
dtype: bfloat16
parameters:
  tol: 1e-9
  max_iter: 35000
tokenizer:
  source: Vortex5/Hollow-Aether-12B