Update README.md
Browse files
README.md
CHANGED
@@ -17,7 +17,7 @@ library_name: transformers
|
|
17 |
|
18 |
# gemma-2-27b-it-abliterated
|
19 |
|
20 |
-
This is a
|
21 |
1. Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
|
22 |
2. Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)
|
23 |
|
|
|
17 |
|
18 |
# gemma-2-27b-it-abliterated
|
19 |
|
20 |
+
This is a new approach for abliterating models using CPU only. I was able to abliterate this model using free kaggle processing with no accelerator.
|
21 |
1. Obtain refusal direction vector using a quant model with llama.cpp (llama-cpp-python and ggml-python).
|
22 |
2. Orthogonalize each .safetensors files directly from original repo and upload to a new repo. (one at a time)
|
23 |
|