| library_name: transformers | |
| tags: [] | |
| # Model Card for koalpaca-polyglot-PEFT-ex | |
| <!-- Provide a quick summary of what the model is/does. --> | |
| This model is the result of the PEFT study. | |
| The study was conducted to understand how to fine-tune the open-source LLM using QLoRA. | |
| This model is not made for the general performance. | |
| So, it is not recommended to use it in practice. | |
| ## Model Details | |
| This model is trained to answer the question about a certain library. | |
| The model is finetuned from "KoAlpaca". | |
| It only trained 0.099% of parameters, using the QLoRA method. | |
| Even Though it trained a small number of parameters, the model gives an actual answer about the data that was trained. | |
| ## Model Description | |
| <!-- Provide a longer summary of what this model is. --> | |
| - **Developed by:** [Chae Minsu](https://github.com/chaeminsoo) | |
| - **Model type:** Text Generation | |
| - **Language(s) (NLP):** Korean | |
| - **Finetuned from model:** [beomi/polyglot-ko-12.8b-safetensors](https://huggingface.co/beomi/polyglot-ko-12.8b-safetensors) | |
| - **Training Data:** Snippet of Kyungpook National University Library FAQ |