Model Card for Model ID

329X DPO'd Model. Finetuned off meta-llama/Llama-3.2-1B. Trained for 1 epoch, learning rate=2e-4, batch_size=1.

PEFT 0.10.0

Downloads last month: 0

Inference Providers NEW

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Model tree for swulee/cs329x-llama-3.2-1B-dpo

Base model

meta-llama/Llama-3.2-1B

Adapter

(266)

this model