Upload folder using huggingface_hub (#1)
Browse files- cd5bc6ff3d1c3bb73d112d92ffaa15495dae644ffd4766f3e0f1bbe72fb08e4c (aace9946624461e667463c9930939e2b7303e865)
- 2ec1ed6172d82d2e17fab9dc196ede7713c34d39452ae017cef629438a10411d (04c65295ce8eccfb7fdfd5d3ba85c20ee7a207d6)
- bb67b5d1bd8bc4fc56125306a82ff017707f9b2c6864e00f7c85aa0b5cd3eec4 (30b2f5fefd2e396173d7b4c48a8aa4ce02567da6)
- 32b0c396ab3541a82c9f76e3a2bbc286dab3be32b84362449280f47ac61367ff (7ea1eec28a4f825a09d9be651ce27cb7ccfcc585)
- 3ea7b205a6af48e53855187a8d07d4621bfabc80e88826cfae4244477e54ac36 (dc3b1d863a180eae874bbfbcfb4a7656d205ae9d)
- b8dd1d9a4b2bb665f3f9a4fc901f7cf89025519e734b18f41382a4a324aa163c (43ade62340e113787aa5bbe7aa8ca0ead42a5033)
- .gitattributes +5 -0
- README.md +33 -0
- Smaug-34B-v0.1_Q2_K.gguf +3 -0
- Smaug-34B-v0.1_Q4_K_M.gguf +3 -0
- Smaug-34B-v0.1_Q5_K_M.gguf +3 -0
- Smaug-34B-v0.1_Q6_K.gguf +3 -0
- Smaug-34B-v0.1_Q8_0.gguf +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
Smaug-34B-v0.1_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
Smaug-34B-v0.1_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
Smaug-34B-v0.1_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
Smaug-34B-v0.1_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
Smaug-34B-v0.1_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,33 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: other
|
3 |
+
license_name: yi-license
|
4 |
+
license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
|
5 |
+
base_model: jondurbin/bagel-34b-v0.2
|
6 |
+
---
|
7 |
+
|
8 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/pf4d6FA7DriRtVq5HCkxd.png)
|
9 |
+
|
10 |
+
|
11 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/e4u8VYfDBh11u60rFYJHF.png)
|
12 |
+
|
13 |
+
This model is a finetune of jondurbin's excellent [bagel](https://huggingface.co/jondurbin/bagel-34b-v0.2) model.
|
14 |
+
It has been trained with new datasets and a new technique, which we will share to the community soon.
|
15 |
+
This model has not utilised any form of merging.
|
16 |
+
|
17 |
+
### Evaluation Results
|
18 |
+
|
19 |
+
| Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
|
20 |
+
| --- | --- | --- | --- | --- | --- | --- |
|
21 |
+
| 77.29 | 74.23 | 86.76 | 76.66 | 70.22 | 83.66 | 72.18 |
|
22 |
+
|
23 |
+
### Contamination Results
|
24 |
+
|
25 |
+
With reference model jondurbin/bagel-34b-v0.2:
|
26 |
+
|
27 |
+
| ARC | TruthfulQA | GSM8K |
|
28 |
+
| --- | --- | --- |
|
29 |
+
| 0.08| 0.38| 0.88|
|
30 |
+
|
31 |
+
***
|
32 |
+
|
33 |
+
Vanilla Quantization by [nold](https://huggingface.co/nold), Original Model [abacusai/Smaug-34B-v0.1](https://huggingface.co/abacusai/Smaug-34B-v0.1). Created using [llm-quantizer](https://github.com/Nold360/llm-quantizer) Pipeline - 465d7970507dcaac4cb50221157a68c840965774
|
Smaug-34B-v0.1_Q2_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:5d7b71bd353d0808244d81f96684fc1cb6815b7bbdcc2316ea5e8ab41403e088
|
3 |
+
size 12825233984
|
Smaug-34B-v0.1_Q4_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:e6c3691d6002ff9f9c0d5b072ba988d90301c714ad5b8c0f26120fd8383be821
|
3 |
+
size 20658711104
|
Smaug-34B-v0.1_Q5_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f9c02730d15f5ea3b48a7552659710bdee922955d97d51df0a61fd064f665392
|
3 |
+
size 24321845824
|
Smaug-34B-v0.1_Q6_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d3f124ad825338a03d918b9c5a96892cd3b1e4eef2c5c9e07fdfd4ef8411fb15
|
3 |
+
size 28213926464
|
Smaug-34B-v0.1_Q8_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bcbe493fb02a0edc16f63bba5a81afb94c183f1112fee761d0b7cfb05e13862d
|
3 |
+
size 36542282304
|