Hugging Face's logo

mradermacher
/
OpenHermes-2.5-Mistral-7B-pruned50-i1-GGUF

Transformers
GGUF
English
nm-vllm
sparse
Inference Endpoints
imatrix
conversational
Model card Files Community
mradermacher commited on
Commit
43e2c43
·
verified ·
1 Parent(s): b11ac09

uploaded from rich1

Browse files
Files changed (23) hide show
  1. .gitattributes +22 -0
  2. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ1_M.gguf +3 -0
  3. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ1_S.gguf +3 -0
  4. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_M.gguf +3 -0
  5. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_S.gguf +3 -0
  6. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_XS.gguf +3 -0
  7. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_XXS.gguf +3 -0
  8. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_M.gguf +3 -0
  9. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_S.gguf +3 -0
  10. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_XS.gguf +3 -0
  11. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_XXS.gguf +3 -0
  12. OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ4_XS.gguf +3 -0
  13. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q2_K.gguf +3 -0
  14. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q2_K_S.gguf +3 -0
  15. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_L.gguf +3 -0
  16. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_M.gguf +3 -0
  17. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_S.gguf +3 -0
  18. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_0.gguf +3 -0
  19. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_K_M.gguf +3 -0
  20. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_K_S.gguf +3 -0
  21. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q5_K_M.gguf +3 -0
  22. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q5_K_S.gguf +3 -0
  23. OpenHermes-2.5-Mistral-7B-pruned50.i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -34,3 +34,25 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
48
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
49
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
50
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
51
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
54
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
55
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
56
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ OpenHermes-2.5-Mistral-7B-pruned50.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20c6f6f890a9003b0c6f649bbc6bbd3bc9e27b5c64629262b52ae345ba020da3
3
+ size 1754455552
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dc621856c11c7e7be9ae2777a56d6e0ace3e9a9986a003c8f3b479c17c76a58
3
+ size 1612111360
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f377f0f36ac79be0b5cd3edee7f2a58f39c632d13cc9dc9d0afed61c795e6dc7
3
+ size 2500723008
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b56cc7e92b7314602ab91e2a42e19dcbb4e80e3647176a23b5661ef8b33c320
3
+ size 2310930752
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04ff8bc6c555178a006eb14a7018252ba85699e273a3dc74f9cc2f377c29c71e
3
+ size 2198265344
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c0aaedb83b7bd7117c82658243f3a3ae5d61a59a552d0ea3129881431c18c73
3
+ size 1991695872
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c343c4d225ea0e97515ef671bd3707a1c4a85c94de884b7b2fdfc8052ea480a
3
+ size 3284903296
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:95d98012f338ab5f5b709cd2f813d7cffdd0fc9bc5fef418c73676fa8c17b640
3
+ size 3182404992
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4999f2ea76b289c3eec2f7811b6c9d5a2c3276a384e42fbf2afcaab03e49ea85
3
+ size 3018827136
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e24b5b05341663a35dd9614bd25db1ef4d9321f9df8ad093afd638bb6ebec69e
3
+ size 2827354432
OpenHermes-2.5-Mistral-7B-pruned50.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4654db6b6365d1e9de692c8b67a430960ff9ae7b07028f665e3425b627da021f
3
+ size 3907700928
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c2ebc86307261374852e59f5929dc00e54ad85f9616e7a835831dc015ced62f1
3
+ size 2719253056
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1169dd1e980cd2103e42a2d23b6e9c8c35f8c68fdb433c91f43b31bbf20c0f5c
3
+ size 2528936512
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8e39f228f8676204c35644ef472380b282e998a9f2a10574063d9ebd7a7d6d9b
3
+ size 3822036352
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afbebda30a0822d11e645b6105b7500d34a898dde7ca6bdaf7b5d8712991adca
3
+ size 3518997888
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a0a0385cd7e813910c62c29129002351a0d82e1acb2fa9e36a3308d08f91e3de
3
+ size 3164579200
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23f62880b1e4d3376ab82b2069fcdcb974b91c3c461afb123e3fa016b22e5c36
3
+ size 4123609536
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86f4eb2ce5ed5e132165532bac5085a17d93faef2cf99ee1e7c05f3edd95540b
3
+ size 4368452032
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:693eee173adab50deb659bf01ae54f05e24558f3af6b3e1b184ce57c12559728
3
+ size 4140386752
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ef4c1c9f439f1850d43170548f779ea3da747726936fee9d6f45526c698e40dd
3
+ size 5131423168
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d346d98e32d1469fde57efa0896a0e8cb27ca7d849c4ddb23ac86e3d62660c3
3
+ size 4997729728
OpenHermes-2.5-Mistral-7B-pruned50.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3b3500aa0b6f5aa577e1b26604e8d0320e864399debbceccd0532205bcd84d18
3
+ size 5942080000