SmithCC
/

dpo_Lora

Text Generation

text-generation-inference

Model card Files Files and versions

Uploaded model

Developed by: SmithCC
License: apache-2.0
Finetuned from model : SmithCC/GRPO_Lora

This qwen2 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: 1

Safetensors

Model size

15B params

Tensor type

BF16

·

Model tree for SmithCC/dpo_Lora

Base model

SmithCC/GRPO_Lora

Finetuned

(1)

this model