Hugging Face's logo

LiteLLMs
/
Mixtral-8x22B-v0.1-GGUF

GGUF
Mixture of Experts
GGUF
Eval Results
Inference Endpoints
Model card Files Community
1
andrijdavid commited on
Commit
be5b401
·
verified ·
1 Parent(s): b5681eb

First model

Browse files
Files changed (11) hide show
  1. .gitattributes +10 -0
  2. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00001.gguf +3 -0
  3. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00009.gguf +3 -0
  4. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00002-of-00009.gguf +3 -0
  5. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00003-of-00009.gguf +3 -0
  6. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00004-of-00009.gguf +3 -0
  7. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00005-of-00009.gguf +3 -0
  8. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00006-of-00009.gguf +3 -0
  9. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00007-of-00009.gguf +3 -0
  10. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00008-of-00009.gguf +3 -0
  11. Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00009-of-00009.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,13 @@ Mixtral-8x22B-v0.1-Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
39
  Mixtral-8x22B-v0.1-Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mixtral-8x22B-v0.1-Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
41
  Mixtral-8x22B-v0.1-Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
39
  Mixtral-8x22B-v0.1-Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
40
  Mixtral-8x22B-v0.1-Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
41
  Mixtral-8x22B-v0.1-Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00001.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
50
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
51
+ Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00001.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:951770e6ec39d024931ee7c2fedf95500ce51ff31799f9eea9dc753fe9657a45
3
+ size 4065845472
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00001-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ee4d17d3a0f0245e3c68e709f69d0b7416a7d88d3d5693fb7ccc28b34c217da7
3
+ size 498815680
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00002-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d4144631920f61abf185ac0dad5ff9128dd490e4882d16aeb48af0c813aa692d
3
+ size 413716352
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00003-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:94a688e9cbda8e93bd8714f37cacda4a4ffac697be2ed99b946fa2977ca8b5d1
3
+ size 420302720
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00004-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d618d92bb9ea965fb186ca3ce4b4f58385cf34e5dc9bb0ca61176b1037d8e83
3
+ size 429838208
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00005-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:65fc6853245f4d3d547ebc103255cf9de68c936822d4752abcd3983a0451ba1d
3
+ size 429838208
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00006-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:21d9c755260c9d2b6774536a9e08a6e2990e2bb883ff41a6d3274cc492cbf983
3
+ size 420302720
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00007-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fc3cdd0134b3653fecfa929c50735dec835ca1cac1d732bb12b573c509a1db6
3
+ size 22284034624
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00008-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:48bdd716dd1a25e20d040bcbec25b5074679baaf3e2c8c1bd4df69f8564369ef
3
+ size 26505908992
Mixtral-8x22B-v0.1-Q3_K_L/Mixtral-8x22B-v0.1-Q3_K_L-00009-of-00009.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b3c74bceb3ff81ef40948c5dabfcba4c3073d0f9fee57e4da4a018b9fe29c345
3
+ size 21177044800