Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-Small-24B-Instruct-2501-GGUF
like
2
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
eedef9c
Mistral-Small-24B-Instruct-2501-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
2263b5df6b94aefc1822b5d41c325a84d9c215da89f3285d07de21f9cce7e797
eedef9c
verified
15 days ago
.gitattributes
1.92 kB
2263b5df6b94aefc1822b5d41c325a84d9c215da89f3285d07de21f9cce7e797
15 days ago
Mistral-Small-24B-Instruct-2501.Q2_K.gguf
8.89 GB
LFS
4c0b34d0fc3ff2c9e6b04379b64836547e7e1f2b99d7ecb8ed358445429feede
15 days ago
Mistral-Small-24B-Instruct-2501.Q3_K_L.gguf
12.4 GB
LFS
fa438cdaa313d360db90f3ab45205950b221d9cc2076673cf0b2bda174e8a75c
15 days ago
Mistral-Small-24B-Instruct-2501.Q3_K_M.gguf
11.5 GB
LFS
d9350fd9035066630a351fc56b5704f98660b2aa546e7fe1d93cc99767ae019d
15 days ago
Mistral-Small-24B-Instruct-2501.Q3_K_S.gguf
10.4 GB
LFS
f64bef4f8e9c61f497cbd71b662b6b36fcd94ec41734f939d235cb17d05318d0
15 days ago
Mistral-Small-24B-Instruct-2501.Q4_K_M.gguf
14.3 GB
LFS
2263b5df6b94aefc1822b5d41c325a84d9c215da89f3285d07de21f9cce7e797
15 days ago