Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
CriteriaPO
/
llama3.2-3b-orpo-finegrained-2e
like
0
Follow
CriteriaPO
3
Text Generation
Transformers
Safetensors
llama
Generated from Trainer
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
llama3.2-3b-orpo-finegrained-2e
/
checkpoint-25000
/
trainer_state.json
obiwit
Training in progress, step 25000, checkpoint
62d3e65
verified
6 months ago
raw
Copy download link
history
contribute
delete
Safe
1.14 MB
File too large to display, you can
check the raw version
instead.