Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
CriteriaPO
/
llama3.2-3b-orpo-finegrained-2e
like
0
Follow
CriteriaPO
4
Text Generation
Transformers
Safetensors
llama
Generated from Trainer
trl
dpo
conversational
text-generation-inference
arxiv:
2305.18290
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
llama3.2-3b-orpo-finegrained-2e
/
trainer_state.json
obiwit
Model save
9896131
verified
6 months ago
raw
Copy download link
history
contribute
delete
Safe
1.26 MB
File too large to display, you can
check the raw version
instead.