---
library_name: transformers
tags: []
---

# koalpaca-polyglot-PEFT-ex

<!-- Provide a quick summary of what the model is/does. -->

This model is the result of the PEFT study.  
The study was conducted to understand how to fine-tune the open-source LLM using QLoRA.  

This model is not made for the general performance.  
So, it is not recommended to use it in practice.


## Model Details

This model is trained to answer the question about a certain library.  
The model is finetuned from "KoAlpaca".  
It only trained 0.099% of parameters, using the QLoRA method.  
Even Though it trained a small number of parameters, the model gives an actual answer about the data that was trained.

## Model Description

<!-- Provide a longer summary of what this model is. -->

- **Developed by:** [Chae Minsu](https://github.com/chaeminsoo)
- **Model type:** Text Generation
- **Language(s) (NLP):** Korean
- **Finetuned from model:** [beomi/polyglot-ko-12.8b-safetensors](https://huggingface.co/beomi/polyglot-ko-12.8b-safetensors)
- **Training Data:** Snippet of Kyungpook National University Library FAQ