Update README.md
Browse files---
base_model: unsloth/mistral-7b-bnb-4bit
library_name: peft
---
# Model Card for Mistral 7B Fine-tuned by Erkinbek Niiazbek uulu
## Model Details
### Model Description
This is a fine-tuned version of the Mistral 7B model developed by Erkinbek Niiazbek uulu for specific use cases. The model was fine-tuned using LoRA (Low-Rank Adaptation) techniques and is optimized for lightweight deployment. The base model used is `unsloth/mistral-7b-bnb-4bit`.
- **Developed by:** Erkinbek Niiazbek uulu
- **Contact Email:** [email protected]
- **Base Model:** unsloth/mistral-7b-bnb-4bit
- **Library Name:** PEFT
- **Language(s):** Multilingual (including Kyrgyz)
- **License:** [Specify your license type, e.g., Apache 2.0, MIT]
- **Fine-tuned from model:** unsloth/mistral-7b-bnb-4bit
---
## Uses
### Direct Use
This fine-tuned model is designed for tasks such as:
- Multilingual question answering
- Text summarization
- Natural language generation
### Downstream Use
This model can be further fine-tuned for domain-specific applications.
### Out-of-Scope Use
This model is not intended for generating harmful, offensive, or unethical content.
---
## Bias, Risks, and Limitations
### Recommendations
While this model has been fine-tuned for specific tasks, users should be cautious of potential biases in the output. It is recommended to review the outputs critically, especially when used in sensitive applications.
---
## How to Get Started with the Model
To load the model, you can use the following code:
```python
# alpaca_prompt = Copied from above
FastLanguageModel.for_inference(model) # Enable native 2x faster inference
inputs = tokenizer(
[
alpaca_prompt.format(
"Зекет деген эмне?", # instruction
"", # input
"", # output - leave this blank for generation!
)
], return_tensors = "pt").to("cuda")
from transformers import TextStreamer
text_streamer = TextStreamer(tokenizer)
_ = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 1024)
### Framework versions
- PEFT 0.14.0
@@ -3,5 +3,71 @@ license: apache-2.0
|
|
3 |
tags:
|
4 |
- unsloth
|
5 |
- kyrgyz
|
6 |
-
|
7 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
tags:
|
4 |
- unsloth
|
5 |
- kyrgyz
|
6 |
+
---
|
7 |
+
|
8 |
+
---
|
9 |
+
base_model: unsloth/mistral-7b-bnb-4bit
|
10 |
+
library_name: peft
|
11 |
+
---
|
12 |
+
# Model Card for Mistral 7B Fine-tuned by Erkinbek Niiazbek uulu
|
13 |
+
|
14 |
+
## Model Details
|
15 |
+
|
16 |
+
### Model Description
|
17 |
+
This is a fine-tuned version of the Mistral 7B model developed by Erkinbek Niiazbek uulu for specific use cases. The model was fine-tuned using LoRA (Low-Rank Adaptation) techniques and is optimized for lightweight deployment. The base model used is `unsloth/mistral-7b-bnb-4bit`.
|
18 |
+
|
19 |
+
- **Developed by:** Erkinbek Niiazbek uulu
|
20 |
+
- **Contact Email:** [email protected]
|
21 |
+
- **Base Model:** unsloth/mistral-7b-bnb-4bit
|
22 |
+
- **Library Name:** PEFT
|
23 |
+
- **Language(s):** Multilingual (including Kyrgyz)
|
24 |
+
- **License:** [Specify your license type, e.g., Apache 2.0, MIT]
|
25 |
+
- **Fine-tuned from model:** unsloth/mistral-7b-bnb-4bit
|
26 |
+
|
27 |
+
---
|
28 |
+
|
29 |
+
## Uses
|
30 |
+
|
31 |
+
### Direct Use
|
32 |
+
This fine-tuned model is designed for tasks such as:
|
33 |
+
- Multilingual question answering
|
34 |
+
- Text summarization
|
35 |
+
- Natural language generation
|
36 |
+
|
37 |
+
### Downstream Use
|
38 |
+
This model can be further fine-tuned for domain-specific applications.
|
39 |
+
|
40 |
+
### Out-of-Scope Use
|
41 |
+
This model is not intended for generating harmful, offensive, or unethical content.
|
42 |
+
|
43 |
+
---
|
44 |
+
|
45 |
+
## Bias, Risks, and Limitations
|
46 |
+
|
47 |
+
### Recommendations
|
48 |
+
While this model has been fine-tuned for specific tasks, users should be cautious of potential biases in the output. It is recommended to review the outputs critically, especially when used in sensitive applications.
|
49 |
+
|
50 |
+
---
|
51 |
+
|
52 |
+
## How to Get Started with the Model
|
53 |
+
|
54 |
+
To load the model, you can use the following code:
|
55 |
+
|
56 |
+
```python
|
57 |
+
# alpaca_prompt = Copied from above
|
58 |
+
FastLanguageModel.for_inference(model) # Enable native 2x faster inference
|
59 |
+
inputs = tokenizer(
|
60 |
+
[
|
61 |
+
alpaca_prompt.format(
|
62 |
+
"Зекет деген эмне?", # instruction
|
63 |
+
"", # input
|
64 |
+
"", # output - leave this blank for generation!
|
65 |
+
)
|
66 |
+
], return_tensors = "pt").to("cuda")
|
67 |
+
|
68 |
+
from transformers import TextStreamer
|
69 |
+
text_streamer = TextStreamer(tokenizer)
|
70 |
+
_ = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 1024)
|
71 |
+
### Framework versions
|
72 |
+
|
73 |
+
- PEFT 0.14.0
|