Hugging Face's logo

ai-sage
/
GigaChat-20B-A3B-instruct-v1.5-GGUF

GGUF
Russian
English
Inference Endpoints
conversational
Model card Files Community
vltnmmdv commited on
Commit
91924df
·
verified ·
1 Parent(s): 912b533

Add files using upload-large-folder tool

Browse files
Files changed (8) hide show
  1. .gitattributes +7 -0
  2. GigaChat-20B-A3B-instruct-v1.5-bf16.gguf +3 -0
  3. GigaChat-20B-A3B-instruct-v1.5-q4_0.gguf +3 -0
  4. GigaChat-20B-A3B-instruct-v1.5-q4_K_M.gguf +3 -0
  5. GigaChat-20B-A3B-instruct-v1.5-q5_0.gguf +3 -0
  6. GigaChat-20B-A3B-instruct-v1.5-q5_K_M.gguf +3 -0
  7. GigaChat-20B-A3B-instruct-v1.5-q6_K.gguf +3 -0
  8. GigaChat-20B-A3B-instruct-v1.5-q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,10 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ GigaChat-20B-A3B-instruct-v1.5-q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
37
+ GigaChat-20B-A3B-instruct-v1.5-q6_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ GigaChat-20B-A3B-instruct-v1.5-q8_0.gguf filter=lfs diff=lfs merge=lfs -text
39
+ GigaChat-20B-A3B-instruct-v1.5-q4_0.gguf filter=lfs diff=lfs merge=lfs -text
40
+ GigaChat-20B-A3B-instruct-v1.5-bf16.gguf filter=lfs diff=lfs merge=lfs -text
41
+ GigaChat-20B-A3B-instruct-v1.5-q5_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ GigaChat-20B-A3B-instruct-v1.5-q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
GigaChat-20B-A3B-instruct-v1.5-bf16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fd97edd08a331faf085b9c0d1b5360972ed79d1558115840421d25fde43d336
3
+ size 41191993280
GigaChat-20B-A3B-instruct-v1.5-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e01455b89448f0359ea330e5f2d9a042ee62e95e8683b52deeb6ec8808218b7b
3
+ size 11667849152
GigaChat-20B-A3B-instruct-v1.5-q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5bd88ebea2a2ee2622c50ec5c0ec88f67169e4667c47762f51a4e2157367923b
3
+ size 12494806976
GigaChat-20B-A3B-instruct-v1.5-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:815baf897dba52ee9b6d8ea59ae709d99f2f56e385c8ee65290674394f36e9d9
3
+ size 14208221120
GigaChat-20B-A3B-instruct-v1.5-q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:933af49d9916493f3e33dc8972a9150d47a5b5eabd710ea8e687720a5d7cb740
3
+ size 14634229696
GigaChat-20B-A3B-instruct-v1.5-q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cb013ff35190b119e459276642fc1d7f97176a6531003ba42a4922d476e015a
3
+ size 16907366336
GigaChat-20B-A3B-instruct-v1.5-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:186b2d1e2865543996782a7a3d247f38f2753619f35a9091ca7c0cfabad161cb
3
+ size 21892952000