Edit Models filters

Misc

text-generation-inference

Inference Endpoints

AutoTrain Compatible

8-bit precision

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

354

Full-text search

Active filters: vllm

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_3.5bpw_H8

Text Generation • Updated 7 days ago • 18

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_4bpw_H8

Text Generation • Updated 7 days ago • 11

ReadyArt/Mistral-Small-24B-Instruct-2501_EXL2_5.0bpw_H8

Updated 7 days ago • 20

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_5.5bpw_H8

Text Generation • Updated 6 days ago • 3

Jellon/Mistral-Small-24B-Instruct-2501-exl2-6bpw

Text Generation • Updated 6 days ago • 16

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_6bpw_H8

Text Generation • Updated 6 days ago • 8

sleepdeprived3/Mistral-Small-24B-Instruct-2501_EXL2_8bpw_H8

Text Generation • Updated 6 days ago • 16

Jellon/Mistral-Small-24B-Instruct-2501-exl2-4bpw

Text Generation • Updated 6 days ago • 8

KnutJaegersberg/Mistral-Small-24B-Instruct-2501-exl2-8.0bpw

Text Generation • Updated 6 days ago • 9

nextinddev/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

Updated 6 days ago • 2.81k

Lucy-in-the-Sky/Mistral-Small-24B-Base-2501-Q3_K_M-GGUF

Updated 6 days ago • 20

Statuo/MS-24b-Instruct-EXL2-3bpw

Text Generation • Updated 6 days ago • 6

lace1/Mistral-Small-24B-Base-2501-Q2_K-GGUF

Updated 5 days ago • 6

neuralmagic-ent/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic

Text Generation • Updated about 9 hours ago • 8

neuralmagic-ent/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic

Text Generation • Updated about 9 hours ago • 20

moot20/Mistral-Small-24B-Instruct-2501-MLX-6bits

Text Generation • Updated 3 days ago • 12

moot20/Mistral-Small-24B-Instruct-2501-MLX-8bits

Text Generation • Updated 3 days ago • 17

fernandoruiz/Mistral-Small-24B-Instruct-2501-Q4_0-GGUF

Updated 4 days ago • 34

moot20/Mistral-Small-24B-Base-2501-MLX-6bits

Text Generation • Updated 4 days ago • 9

moot20/Mistral-Small-24B-Base-2501-MLX-8bits

Text Generation • Updated 4 days ago • 10

mili-tan/Mistral-Small-24B-Instruct-2501-abliterated-Q3_K_M-GGUF

Updated 4 days ago • 43

darkc0de/Mistral-Small-24B-Instruct-2501-abliterated-Q5_K_M-GGUF

Updated 4 days ago • 492

decisionslab/Ministral-8B-Instruct-2410-4bit

Updated 4 days ago • 6

decisionslab/Ministral-8B-Instruct-2410-4bit-HK

Updated 4 days ago

spacematt/Mistral-Small-24B-Instruct-2501-Q4_K_M-GGUF

Updated 4 days ago • 8

Zenabius/Mistral-Small-24B-Instruct-2501-abliterated-Q6_K-GGUF

Updated 4 days ago • 88

dwetzel/Mistral-Small-24B-Instruct-2501-GPTQ-INT4

Text Generation • Updated 2 days ago • 420

JSky74/Mistral-Small-24B-Instruct

Text Generation • Updated 3 days ago • 11

curiousmind147/microsoft-phi-4-AWQ-4bit-GEMM

Text Generation • Updated 2 days ago • 4

bigband/InfiniteNabu

Text Generation • Updated 2 days ago • 13