Edit Models filters

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

31,779

Full-text search

Active filters: bitsandbytes

unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 3.73k • 7

unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated 6 days ago • 1.88k • 7

prithivMLmods/Blazer.1-2B-Vision

Image-Text-to-Text • Updated 22 days ago • 514 • 7

prithivMLmods/Blaze.1-7B-Vision

Image-Text-to-Text • Updated 22 days ago • 323 • 7

unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 12.1k • 12

unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 55.9k • 13

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 4 days ago • 620k • 55

unsloth/DeepSeek-R1-Distill-Qwen-1.5B-unsloth-bnb-4bit

Text Generation • Updated 5 days ago • 18.3k • 10

unsloth/DeepSeek-R1-Distill-Llama-70B-bnb-4bit

Text Generation • Updated 4 days ago • 14.8k • 13

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 917 • 30

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated 22 days ago • 208k • 74

John6666/llama-joycaption-alpha-two-hf-llava-nf4

Image-Text-to-Text • Updated 8 days ago • 343 • 14

unsloth/phi-4-unsloth-bnb-4bit

Text Generation • Updated 24 days ago • 78.3k • 39

lumolabs-ai/Lumo-70B-Instruct

Updated 1 day ago • 212 • 6

unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit

Text Generation • Updated 5 days ago • 11.6k • 4

unsloth/DeepSeek-R1-Distill-Qwen-32B-bnb-4bit

Text Generation • Updated 4 days ago • 89.2k • 11

unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 6 days ago • 43.6k • 3

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 6 days ago • 60 • 2

unsloth/Qwen2.5-VL-72B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 6 days ago • 1.44k • 2

eridai/eridaRE

Text Generation • Updated 4 days ago • 110 • 2

Erland/Mistral-Small-24B-Base-ChatML-2501-bnb-4bit

Text Generation • Updated 4 days ago • 52 • 2

syubraj/MedicalChat-Phi-3.5-mini-instruct

Text Generation • Updated about 22 hours ago • 2

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 261 • 26

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 10.8k • 10

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 17 • 5

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 20.2k • 25

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 488 • 4

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 455 • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 11.3k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.83k • 10