Niiazbek commited on
Commit
0d1c42a
·
verified ·
1 Parent(s): 750c1de

Update README.md

Browse files

---
base_model: unsloth/mistral-7b-bnb-4bit
library_name: peft
---
# Model Card for Mistral 7B Fine-tuned by Erkinbek Niiazbek uulu

## Model Details

### Model Description
This is a fine-tuned version of the Mistral 7B model developed by Erkinbek Niiazbek uulu for specific use cases. The model was fine-tuned using LoRA (Low-Rank Adaptation) techniques and is optimized for lightweight deployment. The base model used is `unsloth/mistral-7b-bnb-4bit`.

- **Developed by:** Erkinbek Niiazbek uulu
- **Contact Email:** [email protected]
- **Base Model:** unsloth/mistral-7b-bnb-4bit
- **Library Name:** PEFT
- **Language(s):** Multilingual (including Kyrgyz)
- **License:** [Specify your license type, e.g., Apache 2.0, MIT]
- **Fine-tuned from model:** unsloth/mistral-7b-bnb-4bit

---

## Uses

### Direct Use
This fine-tuned model is designed for tasks such as:
- Multilingual question answering
- Text summarization
- Natural language generation

### Downstream Use
This model can be further fine-tuned for domain-specific applications.

### Out-of-Scope Use
This model is not intended for generating harmful, offensive, or unethical content.

---

## Bias, Risks, and Limitations

### Recommendations
While this model has been fine-tuned for specific tasks, users should be cautious of potential biases in the output. It is recommended to review the outputs critically, especially when used in sensitive applications.

---

## How to Get Started with the Model

To load the model, you can use the following code:

```python
# alpaca_prompt = Copied from above
FastLanguageModel.for_inference(model) # Enable native 2x faster inference
inputs = tokenizer(
[
alpaca_prompt.format(
"Зекет деген эмне?", # instruction
"", # input
"", # output - leave this blank for generation!
)
], return_tensors = "pt").to("cuda")

from transformers import TextStreamer
text_streamer = TextStreamer(tokenizer)
_ = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 1024)
### Framework versions

- PEFT 0.14.0

Files changed (1) hide show
  1. README.md +68 -2
README.md CHANGED
@@ -3,5 +3,71 @@ license: apache-2.0
3
  tags:
4
  - unsloth
5
  - kyrgyz
6
- - llm
7
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  tags:
4
  - unsloth
5
  - kyrgyz
6
+ ---
7
+
8
+ ---
9
+ base_model: unsloth/mistral-7b-bnb-4bit
10
+ library_name: peft
11
+ ---
12
+ # Model Card for Mistral 7B Fine-tuned by Erkinbek Niiazbek uulu
13
+
14
+ ## Model Details
15
+
16
+ ### Model Description
17
+ This is a fine-tuned version of the Mistral 7B model developed by Erkinbek Niiazbek uulu for specific use cases. The model was fine-tuned using LoRA (Low-Rank Adaptation) techniques and is optimized for lightweight deployment. The base model used is `unsloth/mistral-7b-bnb-4bit`.
18
+
19
+ - **Developed by:** Erkinbek Niiazbek uulu
20
+ - **Contact Email:** [email protected]
21
+ - **Base Model:** unsloth/mistral-7b-bnb-4bit
22
+ - **Library Name:** PEFT
23
+ - **Language(s):** Multilingual (including Kyrgyz)
24
+ - **License:** [Specify your license type, e.g., Apache 2.0, MIT]
25
+ - **Fine-tuned from model:** unsloth/mistral-7b-bnb-4bit
26
+
27
+ ---
28
+
29
+ ## Uses
30
+
31
+ ### Direct Use
32
+ This fine-tuned model is designed for tasks such as:
33
+ - Multilingual question answering
34
+ - Text summarization
35
+ - Natural language generation
36
+
37
+ ### Downstream Use
38
+ This model can be further fine-tuned for domain-specific applications.
39
+
40
+ ### Out-of-Scope Use
41
+ This model is not intended for generating harmful, offensive, or unethical content.
42
+
43
+ ---
44
+
45
+ ## Bias, Risks, and Limitations
46
+
47
+ ### Recommendations
48
+ While this model has been fine-tuned for specific tasks, users should be cautious of potential biases in the output. It is recommended to review the outputs critically, especially when used in sensitive applications.
49
+
50
+ ---
51
+
52
+ ## How to Get Started with the Model
53
+
54
+ To load the model, you can use the following code:
55
+
56
+ ```python
57
+ # alpaca_prompt = Copied from above
58
+ FastLanguageModel.for_inference(model) # Enable native 2x faster inference
59
+ inputs = tokenizer(
60
+ [
61
+ alpaca_prompt.format(
62
+ "Зекет деген эмне?", # instruction
63
+ "", # input
64
+ "", # output - leave this blank for generation!
65
+ )
66
+ ], return_tensors = "pt").to("cuda")
67
+
68
+ from transformers import TextStreamer
69
+ text_streamer = TextStreamer(tokenizer)
70
+ _ = model.generate(**inputs, streamer = text_streamer, max_new_tokens = 1024)
71
+ ### Framework versions
72
+
73
+ - PEFT 0.14.0