Upload folder using huggingface_hub (#1)
Browse files- a602eb48264f7b4341461dd86819a0643dce1bb78919b25dbb32d951ee711c89 (57df0cd9744f7cbc45ad42e5a20eab29116ceec8)
- 0412d4185f614ccaf5bde9a824e2595b55b7fe627822b457a4121ed2fb51af3f (585e75c9187cfb7bfc15bd5a47fd2e18b53071fa)
- 939097d0f92d4f5921a85a63a70e4a33ba0c52c0700484cc0539cc92a58afdce (b915a696d6d65637524dc6299e0c7ce4c5dc27ce)
- bf7116217c02243a0337ee06239bb1fbe78102141a49387eac591b1a10b2e33c (98ac85de15985f549d8c936f5a14f8c81a66b823)
- c980670a89fac77f3cac606b97f323f45929f853a4cafe79d55c959baee116e7 (d4e9740f10804e297b0b7f94c0edd3e80688293c)
- 7ee74dfbce69f87b4640feb67fb0d1ca34d1310900f4dffb6ddf0f0ef328c97f (0c1954b8bc76c255918778557cfd4c1eed3c54f3)
- 99790d2ee6775916e081cc3f976cb7fb2a84209788d09499805677018e920eb4 (eafe2f6fad88f42d6bb0734de84e0a0b5248d751)
- 24351101a4161c493d5db63a8628d38b73f2c497e99eb7d3c279119ff150d2d0 (22ab7840447d61f286744892b8a058842c5dcff9)
- 511c884de59cd4236a4a513d87ffe7bb4a4eb7bdd6a45efb2eec1f24bddc9871 (0c5e7a20286e0450fe34f727aae56931770e7ef9)
- c86e5afd23924b76f4e1adeb5d95d0d599829f2c50c9d3571492fbab01973595 (af0f5fc7d280a0259696313b4d63b11b8c999464)
- 59700d3d4e75cb4736ff23f17171ed10ad920e10dd38e452508e68c6eacdc6b8 (274ae54eca2cf544b3a13c89f404456563829cdc)
- .gitattributes +10 -0
- README.md +57 -0
- mergekit-passthrough-zpfenfn.Q2_K.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q3_K_L.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q3_K_M.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q3_K_S.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q4_K_M.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q4_K_S.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q5_K_M.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q5_K_S.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q6_K.gguf +3 -0
- mergekit-passthrough-zpfenfn.Q8_0.gguf +3 -0
@@ -33,3 +33,13 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
mergekit-passthrough-zpfenfn.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
mergekit-passthrough-zpfenfn.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
mergekit-passthrough-zpfenfn.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
mergekit-passthrough-zpfenfn.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
mergekit-passthrough-zpfenfn.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
41 |
+
mergekit-passthrough-zpfenfn.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
42 |
+
mergekit-passthrough-zpfenfn.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
43 |
+
mergekit-passthrough-zpfenfn.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
+
mergekit-passthrough-zpfenfn.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
+
mergekit-passthrough-zpfenfn.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
@@ -0,0 +1,57 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
tags:
|
3 |
+
- quantized
|
4 |
+
- 2-bit
|
5 |
+
- 3-bit
|
6 |
+
- 4-bit
|
7 |
+
- 5-bit
|
8 |
+
- 6-bit
|
9 |
+
- 8-bit
|
10 |
+
- GGUF
|
11 |
+
- transformers
|
12 |
+
- safetensors
|
13 |
+
- llama
|
14 |
+
- text-generation
|
15 |
+
- mergekit
|
16 |
+
- merge
|
17 |
+
- conversational
|
18 |
+
- base_model:cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
|
19 |
+
- autotrain_compatible
|
20 |
+
- endpoints_compatible
|
21 |
+
- text-generation-inference
|
22 |
+
- region:us
|
23 |
+
- text-generation
|
24 |
+
model_name: mergekit-passthrough-zpfenfn-GGUF
|
25 |
+
base_model: mergekit-community/mergekit-passthrough-zpfenfn
|
26 |
+
inference: false
|
27 |
+
model_creator: mergekit-community
|
28 |
+
pipeline_tag: text-generation
|
29 |
+
quantized_by: MaziyarPanahi
|
30 |
+
---
|
31 |
+
# [MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF)
|
32 |
+
- Model creator: [mergekit-community](https://huggingface.co/mergekit-community)
|
33 |
+
- Original model: [mergekit-community/mergekit-passthrough-zpfenfn](https://huggingface.co/mergekit-community/mergekit-passthrough-zpfenfn)
|
34 |
+
|
35 |
+
## Description
|
36 |
+
[MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF](https://huggingface.co/MaziyarPanahi/mergekit-passthrough-zpfenfn-GGUF) contains GGUF format model files for [mergekit-community/mergekit-passthrough-zpfenfn](https://huggingface.co/mergekit-community/mergekit-passthrough-zpfenfn).
|
37 |
+
|
38 |
+
### About GGUF
|
39 |
+
|
40 |
+
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
|
41 |
+
|
42 |
+
Here is an incomplete list of clients and libraries that are known to support GGUF:
|
43 |
+
|
44 |
+
* [llama.cpp](https://github.com/ggerganov/llama.cpp). The source project for GGUF. Offers a CLI and a server option.
|
45 |
+
* [llama-cpp-python](https://github.com/abetlen/llama-cpp-python), a Python library with GPU accel, LangChain support, and OpenAI-compatible API server.
|
46 |
+
* [LM Studio](https://lmstudio.ai/), an easy-to-use and powerful local GUI for Windows and macOS (Silicon), with GPU acceleration. Linux available, in beta as of 27/11/2023.
|
47 |
+
* [text-generation-webui](https://github.com/oobabooga/text-generation-webui), the most widely used web UI, with many features and powerful extensions. Supports GPU acceleration.
|
48 |
+
* [KoboldCpp](https://github.com/LostRuins/koboldcpp), a fully featured web UI, with GPU accel across all platforms and GPU architectures. Especially good for story telling.
|
49 |
+
* [GPT4All](https://gpt4all.io/index.html), a free and open source local running GUI, supporting Windows, Linux and macOS with full GPU accel.
|
50 |
+
* [LoLLMS Web UI](https://github.com/ParisNeo/lollms-webui), a great web UI with many interesting and unique features, including a full model library for easy model selection.
|
51 |
+
* [Faraday.dev](https://faraday.dev/), an attractive and easy to use character-based chat GUI for Windows and macOS (both Silicon and Intel), with GPU acceleration.
|
52 |
+
* [candle](https://github.com/huggingface/candle), a Rust ML framework with a focus on performance, including GPU support, and ease of use.
|
53 |
+
* [ctransformers](https://github.com/marella/ctransformers), a Python library with GPU accel, LangChain support, and OpenAI-compatible AI server. Note, as of time of writing (November 27th 2023), ctransformers has not been updated in a long time and does not support many recent models.
|
54 |
+
|
55 |
+
## Special thanks
|
56 |
+
|
57 |
+
🙏 Special thanks to [Georgi Gerganov](https://github.com/ggerganov) and the whole team working on [llama.cpp](https://github.com/ggerganov/llama.cpp/) for making all of this possible.
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:ee03fd8d591af6e0f3d4ca2ba1e1051b9aa94b50651310f49838138370b01cfd
|
3 |
+
size 8726274080
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bd34f3eb505d90d0d0adc09d766ce700c5b3ae92ab4c033b77063dd03d96472c
|
3 |
+
size 12284612640
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f23b9a9a5e3fb3e4a31bf81f5f0265d40a1f09fa7f3cb5a3749ff20517a230a2
|
3 |
+
size 11295543328
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:31d1aff1e4bd35e68ce2923d9d4d6efa7dc3867a3c4e30a938a4d31b861589c9
|
3 |
+
size 10165178400
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:24c1e99d0e0ebdfab2b295ace025d2de93f62cd47cd1b3864f0c0a9a7623725a
|
3 |
+
size 13984432160
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:9ac725c439ad6184f38262748c7bf27c6390a9bb49ec826c63d2e92c94954e6c
|
3 |
+
size 13285064736
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:b24ad8f93a11584846bf74c0266be846ed0a5e9cbc4943f1859c1900d5f2c074
|
3 |
+
size 16445636640
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:aad9047d51b8989dc8f32fb3563996538334dec09502681a2209140d21be4d83
|
3 |
+
size 16036200480
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:33aa1bd09b03640d3cfffcc609efd7eabbb60b8daf70a223188ca5be38f4174c
|
3 |
+
size 19060666400
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:db8c57fd733d04b182ec236d1e7d2e5a3bfa55d285e9da9e82fa0a966e54a184
|
3 |
+
size 24686972960
|