Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
JayHyeon
/
Qwen2.5-0.5B-SFT-2e-5-2ep-IRPO_1e-7-3ep_1alp_0lam
like
0
Text Generation
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
qwen2
Generated from Trainer
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Qwen2.5-0.5B-SFT-2e-5-2ep-IRPO_1e-7-3ep_1alp_0lam
Commit History
End of training
d8cf797
verified
JayHyeon
commited on
Jan 6
Model save
71324d6
verified
JayHyeon
commited on
Jan 6
Training in progress, step 2910
9da49d0
verified
JayHyeon
commited on
Jan 6
Training in progress, step 2500
47e7234
verified
JayHyeon
commited on
Jan 5
Training in progress, step 2000
ad6e6da
verified
JayHyeon
commited on
Jan 5
Training in progress, step 1500
ec37720
verified
JayHyeon
commited on
Jan 5
Training in progress, step 1000
9a56b60
verified
JayHyeon
commited on
Jan 5
Training in progress, step 500
2a8a704
verified
JayHyeon
commited on
Jan 5
initial commit
093d0ce
verified
JayHyeon
commited on
Jan 5