Minor addition
Browse files
README.md
CHANGED
@@ -40,6 +40,11 @@ If the first clone gives you problems (takes too long) you can also:
|
|
40 |
|
41 |
Then your model will be inside the downloaded folder.
|
42 |
|
|
|
|
|
|
|
|
|
|
|
43 |
## Future additions
|
44 |
- [ ] Converting Qwen 2 and Llama 2
|
45 |
- [ ] Adding other compatible Rockchip's SoCs
|
|
|
40 |
|
41 |
Then your model will be inside the downloaded folder.
|
42 |
|
43 |
+
## RKLLM parameters used
|
44 |
+
RK3588 **only supports w8a8 quantization**, so that was the selected quantization for ALL models.
|
45 |
+
Aside from that, RKLLM toolkit allows for no optimization (0) and optimization (1).
|
46 |
+
All models are optimized.
|
47 |
+
|
48 |
## Future additions
|
49 |
- [ ] Converting Qwen 2 and Llama 2
|
50 |
- [ ] Adding other compatible Rockchip's SoCs
|