Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

23,851

Full-text search

Active filters: 4-bit

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 3 days ago • 14.2k • 19

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 3.73k • 7

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 6 days ago • 1.88k • 7

mlx-community/Mistral-Small-24B-Instruct-2501-4bit

Updated 7 days ago • 625 • 6

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 7 days ago • 2.07k • 6

prithivMLmods/Blazer.1-2B-Vision

Image-Text-to-Text • Updated 22 days ago • 514 • 7

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 17 days ago • 12.8k • 12

casperhansen/mistral-small-24b-instruct-2501-awq

Updated 7 days ago • 2.49k • 5

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated 22 days ago • 323 • 7

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • Updated 15 days ago • 13.4k • 36

unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 12.1k • 12

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 55.9k • 13

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 1.36M • 87

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 4 days ago • 620k • 55

internlm/internlm3-8b-instruct-gptq-int4

Text Generation • Updated 22 days ago • 246 • 3

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated 4 days ago • 14.8k • 13

casperhansen/deepseek-r1-distill-qwen-14b-awq

Updated 17 days ago • 4.57k • 7

mlx-community/DeepSeek-R1-Distill-Qwen-7B-4bit

Updated 17 days ago • 13.7k • 8

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated 17 days ago • 21.6k • 7

TheBloke/storytime-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 330 • 36

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • Updated Nov 29, 2023 • 57 • 7

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 90 • 5

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 1.26M • 77

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 1.36M • 78

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 917 • 30

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated 22 days ago • 208k • 74

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18, 2024 • 12.9k • 14

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 8.6k • 4

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 25.1k • 18

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 4 days ago • 4.99k • 15