rafaelldietrich commited on
Commit
411a3a9
verified
1 Parent(s): 7a4e997

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: VijayRam1812/Mistral-7B-Business
3
+ datasets:
4
+ - theoldmandthesea/17k_business_book
5
+ library_name: peft
6
+ license: apache-2.0
7
+ tags:
8
+ - trl
9
+ - sft
10
+ - generated_from_trainer
11
+ - llama-cpp
12
+ - gguf-my-lora
13
+ language:
14
+ - en
15
+ pipeline_tag: question-answering
16
+ model-index:
17
+ - name: business_mistral-v1.0
18
+ results: []
19
+ ---
20
+
21
+ # rafaelldietrich/Mistral-7B-Business-F16-GGUF
22
+ This LoRA adapter was converted to GGUF format from [`VijayRam1812/Mistral-7B-Business`](https://huggingface.co/VijayRam1812/Mistral-7B-Business) via the ggml.ai's [GGUF-my-lora](https://huggingface.co/spaces/ggml-org/gguf-my-lora) space.
23
+ Refer to the [original adapter repository](https://huggingface.co/VijayRam1812/Mistral-7B-Business) for more details.
24
+
25
+ ## Use with llama.cpp
26
+
27
+ ```bash
28
+ # with cli
29
+ llama-cli -m base_model.gguf --lora Mistral-7B-Business-f16.gguf (...other args)
30
+
31
+ # with server
32
+ llama-server -m base_model.gguf --lora Mistral-7B-Business-f16.gguf (...other args)
33
+ ```
34
+
35
+ To know more about LoRA usage with llama.cpp server, refer to the [llama.cpp server documentation](https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md).