This is a finetuned model I have made using QLora (PEFT) with lora_r = 64 (help decide the matrice size where the weights will change) and lora_alpha = 16 (defines the intensity with which the lora will change the paramters) which are the majorly important hyperparameters of QLora which I learnt recently with the help of Krish Naik.

Downloads last month
0
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Dataset used to train shreeyans1298/Llama-2-7b-chat-finetune-health-chatbot