Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

23,863

Full-text search

Active filters: 4-bit

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 4 days ago • 4.99k • 15

mlx-community/DeepSeek-V3-4bit

Updated 30 days ago • 207k • 7

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated 24 days ago • 78.3k • 39

lumolabs-ai/Lumo-70B-Instruct

Updated 1 day ago • 212 • 6

unsloth/DeepSeek-R1-Distill-Qwen-1.5B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 18.3k • 9

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 11.6k • 4

mlx-community/DeepSeek-R1-Distill-Qwen-1.5B-4bit

Updated 17 days ago • 6.44k • 2

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated 4 days ago • 89.2k • 11

waldie/DeepSeek-R1-Distill-Qwen-32B-4bpw-h6-exl2

Updated 17 days ago • 374 • 5

mlx-community/DeepSeek-R1-Distill-Llama-8B-4bit

Updated 17 days ago • 175k • 3

inarikami/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 14 days ago • 72k • 3

mlx-community/DeepSeek-R1-Distill-Qwen-32B-4bit

Text Generation • Updated 16 days ago • 167k • 26

unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 6 days ago • 43.6k • 3

mlx-community/DeepSeek-R1-Distill-Qwen-32B-Japanese-4bit

Text Generation • Updated 10 days ago • 180 • 2

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated 7 days ago • 73.3k • 2

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 6 days ago • 60 • 2

unsloth/Qwen2.5-VL-72B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 6 days ago • 1.44k • 2

eridai/eridaRE

Text Generation • Updated 4 days ago • 110 • 2

Erland/Mistral-Small-24B-Base-ChatML-2501-bnb-4bit

Text Generation • Updated 4 days ago • 52 • 2

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-4bit

Text Generation • Updated 3 days ago • 51 • 2

syubraj/MedicalChat-Phi-3.5-mini-instruct

Text Generation • Updated about 21 hours ago • 2

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 53 • 219

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 4.02k • 318

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 793 • 573

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 28 • 13

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 201 • 176

TheBloke/WizardLM-13B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 87 • 46

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 450 • 144

TheBloke/Pygmalion-7B-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 275 • 15

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 36.6k • 362