nold commited on
Commit
80aaaea
·
verified ·
1 Parent(s): a7fdc60

Upload folder using huggingface_hub (#1)

Browse files

- cd5bc6ff3d1c3bb73d112d92ffaa15495dae644ffd4766f3e0f1bbe72fb08e4c (aace9946624461e667463c9930939e2b7303e865)
- 2ec1ed6172d82d2e17fab9dc196ede7713c34d39452ae017cef629438a10411d (04c65295ce8eccfb7fdfd5d3ba85c20ee7a207d6)
- bb67b5d1bd8bc4fc56125306a82ff017707f9b2c6864e00f7c85aa0b5cd3eec4 (30b2f5fefd2e396173d7b4c48a8aa4ce02567da6)
- 32b0c396ab3541a82c9f76e3a2bbc286dab3be32b84362449280f47ac61367ff (7ea1eec28a4f825a09d9be651ce27cb7ccfcc585)
- 3ea7b205a6af48e53855187a8d07d4621bfabc80e88826cfae4244477e54ac36 (dc3b1d863a180eae874bbfbcfb4a7656d205ae9d)
- b8dd1d9a4b2bb665f3f9a4fc901f7cf89025519e734b18f41382a4a324aa163c (43ade62340e113787aa5bbe7aa8ca0ead42a5033)

.gitattributes CHANGED
@@ -33,3 +33,8 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Smaug-34B-v0.1_Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Smaug-34B-v0.1_Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Smaug-34B-v0.1_Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Smaug-34B-v0.1_Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Smaug-34B-v0.1_Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,33 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: yi-license
4
+ license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
5
+ base_model: jondurbin/bagel-34b-v0.2
6
+ ---
7
+
8
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/pf4d6FA7DriRtVq5HCkxd.png)
9
+
10
+
11
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64c14f6b02e1f8f67c73bd05/e4u8VYfDBh11u60rFYJHF.png)
12
+
13
+ This model is a finetune of jondurbin's excellent [bagel](https://huggingface.co/jondurbin/bagel-34b-v0.2) model.
14
+ It has been trained with new datasets and a new technique, which we will share to the community soon.
15
+ This model has not utilised any form of merging.
16
+
17
+ ### Evaluation Results
18
+
19
+ | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
20
+ | --- | --- | --- | --- | --- | --- | --- |
21
+ | 77.29 | 74.23 | 86.76 | 76.66 | 70.22 | 83.66 | 72.18 |
22
+
23
+ ### Contamination Results
24
+
25
+ With reference model jondurbin/bagel-34b-v0.2:
26
+
27
+ | ARC | TruthfulQA | GSM8K |
28
+ | --- | --- | --- |
29
+ | 0.08| 0.38| 0.88|
30
+
31
+ ***
32
+
33
+ Vanilla Quantization by [nold](https://huggingface.co/nold), Original Model [abacusai/Smaug-34B-v0.1](https://huggingface.co/abacusai/Smaug-34B-v0.1). Created using [llm-quantizer](https://github.com/Nold360/llm-quantizer) Pipeline - 465d7970507dcaac4cb50221157a68c840965774
Smaug-34B-v0.1_Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d7b71bd353d0808244d81f96684fc1cb6815b7bbdcc2316ea5e8ab41403e088
3
+ size 12825233984
Smaug-34B-v0.1_Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6c3691d6002ff9f9c0d5b072ba988d90301c714ad5b8c0f26120fd8383be821
3
+ size 20658711104
Smaug-34B-v0.1_Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f9c02730d15f5ea3b48a7552659710bdee922955d97d51df0a61fd064f665392
3
+ size 24321845824
Smaug-34B-v0.1_Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d3f124ad825338a03d918b9c5a96892cd3b1e4eef2c5c9e07fdfd4ef8411fb15
3
+ size 28213926464
Smaug-34B-v0.1_Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcbe493fb02a0edc16f63bba5a81afb94c183f1112fee761d0b7cfb05e13862d
3
+ size 36542282304