Update README.md
Browse files
README.md
CHANGED
@@ -27,8 +27,6 @@ license: cc-by-nc-4.0
|
|
27 |
|
28 |
# Quant Infos
|
29 |
|
30 |
-
## Based on new(2024/05/03) version
|
31 |
-
|
32 |
- Requantized for recent bpe pre-tokenizer fixes https://github.com/ggerganov/llama.cpp/pull/6920
|
33 |
- quants done with an importance matrix for improved quantization loss
|
34 |
- 0, K & IQ quants in basically all variants from Q8 down to IQ1_S
|
|
|
27 |
|
28 |
# Quant Infos
|
29 |
|
|
|
|
|
30 |
- Requantized for recent bpe pre-tokenizer fixes https://github.com/ggerganov/llama.cpp/pull/6920
|
31 |
- quants done with an importance matrix for improved quantization loss
|
32 |
- 0, K & IQ quants in basically all variants from Q8 down to IQ1_S
|