Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
JayHyeon
/
Qwen2.5-0.5B-SFT-2e-5-2ep-IRPO_5e-6-3ep_1alp_0lam
like
0
Text Generation
Transformers
Safetensors
trl-lib/ultrafeedback_binarized
qwen2
Generated from Trainer
trl
dpo
conversational
text-generation-inference
Inference Endpoints
arxiv:
2305.18290
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
Qwen2.5-0.5B-SFT-2e-5-2ep-IRPO_5e-6-3ep_1alp_0lam
Commit History
End of training
1ebb2a4
verified
JayHyeon
commited on
Jan 2
Model save
75c54a4
verified
JayHyeon
commited on
Jan 2
Training in progress, step 2910
c9049a5
verified
JayHyeon
commited on
Jan 2
Training in progress, step 2500
0b9202a
verified
JayHyeon
commited on
Jan 2
Training in progress, step 2000
11e14d1
verified
JayHyeon
commited on
Jan 2
Training in progress, step 1500
cad419d
verified
JayHyeon
commited on
Jan 2
Training in progress, step 1000
82973a6
verified
JayHyeon
commited on
Jan 2
Training in progress, step 500
b1059d9
verified
JayHyeon
commited on
Jan 2
initial commit
10f280c
verified
JayHyeon
commited on
Jan 2