Update README.md
Browse filesUpdate command string
README.md
CHANGED
@@ -10,10 +10,13 @@ This is exl2 5.53bpw quant of Vicuna, specifically https://huggingface.co/lmsys/
|
|
10 |
|
11 |
More notes on the original model can be found here [lmSys page](https://github.com/lm-sys/FastChat/blob/main/docs/vicuna_weights_version.md).
|
12 |
|
13 |
-
`python convert.py -i C:\webui\models\
|
14 |
-
-
|
15 |
-
-
|
16 |
-
-
|
|
|
|
|
|
|
17 |
|
18 |
## Original Model Details
|
19 |
|
|
|
10 |
|
11 |
More notes on the original model can be found here [lmSys page](https://github.com/lm-sys/FastChat/blob/main/docs/vicuna_weights_version.md).
|
12 |
|
13 |
+
`python convert.py -i C:\webui\models\lmsys_vicuna-13b-v1.5-16k -o C:\webui\models\Processed
|
14 |
+
-nr -om lmsys_vicuna-13b-v1.5-16k_measurement.json -mr 15 -gr 15
|
15 |
+
-c "C:\webui\repositories\exllamav2\WizardLM_evol_instruct_V2_196k_0000.parquet"
|
16 |
+
&& python convert.py -i C:\webui\models\lmsys_vicuna-13b-v1.5-16k -o C:\webui\models\Processed
|
17 |
+
-nr -m lmsys_vicuna-13b-v1.5-16k_measurement.json -b 5.53 -gr 40
|
18 |
+
-c "C:\webui\repositories\exllamav2\WizardLM_evol_instruct_V2_196k_0000.parquet"
|
19 |
+
-cf lmsys_vicuna-13b-v1.5-16k-exl2-5.53bpw -ss 4000 `
|
20 |
|
21 |
## Original Model Details
|
22 |
|