8ffcc74f-fb1a-41a3-b83d-4c4d800b7ce5

This model is a fine-tuned version of unsloth/SmolLM2-1.7B-Instruct on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.2684

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 0.000217
• train_batch_size: 4
• eval_batch_size: 4
• seed: 170
• gradient_accumulation_steps: 2
• total_train_batch_size: 8
• optimizer: Use OptimizerNames.ADAMW_BNB with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: cosine
• lr_scheduler_warmup_steps: 50
• training_steps: 500

Training results

Training Loss	Epoch	Step	Validation Loss
No log	0.0000	1	0.9226
0.3205	0.0007	50	0.3274
0.3013	0.0013	100	0.2924
0.3417	0.0020	150	0.2947
0.2705	0.0027	200	0.2851
0.2784	0.0033	250	0.2801
0.2194	0.0040	300	0.2743
0.2545	0.0047	350	0.2727
0.2622	0.0053	400	0.2697
0.3001	0.0060	450	0.2685
0.2231	0.0067	500	0.2684

Framework versions

• PEFT 0.13.2
• Transformers 4.46.0
• Pytorch 2.5.0+cu124
• Datasets 3.0.1
• Tokenizers 0.20.1