merge

This is a merge of pre-trained language models created using mergekit.

Merge Method

This model was merged using the SLERP merge method.

Models Merged

The following models were included in the merge:

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: huihui-ai/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2
  - model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
merge_method: slerp
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-14B
dtype: bfloat16
parameters:
  t: [0, 0.5, 0.7, 1, 0.7, 0.5, 0]

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 35.74
IFEval (0-Shot) 45.15
BBH (3-Shot) 38.72
MATH Lvl 5 (4-Shot) 39.50
GPQA (0-shot) 19.13
MuSR (0-shot) 31.92
MMLU-PRO (5-shot) 40.01
Downloads last month
170
Safetensors
Model size
14.8B params
Tensor type
BF16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Triangle104/DS-R1-Distill-Q2.5-14B-Harmony_V0.1

Collections including Triangle104/DS-R1-Distill-Q2.5-14B-Harmony_V0.1

Evaluation results