metadata
base_model:
- huihui-ai/DeepSeek-R1-Distill-Llama-8B-abliterated
- NousResearch/Hermes-3-Llama-3.1-8B
- allenai/Llama-3.1-Tulu-3-8B
library_name: transformers
tags:
- mergekit
- merge
language:
- en
new_version: chaphi/SAXON-0-I
SAXON-0
This is the base model for the SAXON model series, resulting from a merge of pre-trained language models created using mergekit. It is not yet finetuned on the SAXON dataset.
Merge Details
Merge Method
This model was merged using the TIES merge method using an uncensored version of DeepSeek-R1-Distill-Llama-8B as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: NousResearch/Hermes-3-Llama-3.1-8B
parameters:
density: 0.5
weight: 0.5
- model: allenai/Llama-3.1-Tulu-3-8B
parameters:
density: 0.5
weight: 0.5
merge_method: ties
base_model: huihui-ai/DeepSeek-R1-Distill-Llama-8B-abliterated
parameters:
normalize: false
int8_mask: true
dtype: float16