Edit Models filters

Inference Providers

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

31,867

Full-text search

Active filters: bitsandbytes

unsloth/Qwen2.5-Coder-32B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 904 • 2

unsloth/Qwen2.5-Coder-32B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 2.38k • 2

unsloth/Qwen2.5-Coder-14B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 6.08k • 1

unsloth/Qwen2.5-Coder-14B-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 820 • 3

unsloth/Qwen2.5-0.5-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 175 • 1

cmarkea/Qwen2.5-32B-Instruct-4bit

Text Generation • Updated Nov 14, 2024 • 45 • 3

PrunaAI/suriya7-conversational-gpt-1-bnb-8bit-smashed

Updated Nov 18, 2024 • 4 • 1

unsloth/Qwen2-VL-2B-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22, 2024 • 264 • 1

unsloth/Qwen2-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22, 2024 • 1.26k • 5

unsloth/Pixtral-12B-Base-2409-bnb-4bit

Image-Text-to-Text • Updated Nov 21, 2024 • 264 • 1

unsloth/Pixtral-12B-2409-bnb-4bit

Image-Text-to-Text • Updated Nov 21, 2024 • 870 • 3

unsloth/Qwen2-VL-72B-Instruct-bnb-4bit

Image-Text-to-Text • Updated Nov 22, 2024 • 767 • 3

unsloth/Llama-3.1-Tulu-3-8B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 132 • 1

unsloth/Llama-3.1-Tulu-3-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 1.38k • 1

Alkamal01/llama-3.2-quantized-4bit

Updated Nov 27, 2024 • 7 • 1

unsloth/QwQ-32B-Preview-bnb-4bit

Text Generation • Updated Nov 28, 2024 • 1.48k • 3

unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 18.8k • 5

unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 43k • 9

unsloth/QwQ-32B-Preview-unsloth-bnb-4bit

Text Generation • Updated Dec 6, 2024 • 874 • 18

unsloth/Pixtral-12B-2409-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 3.85k • 5

unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit

Image-Text-to-Text • Updated Dec 4, 2024 • 1.08k • 3

unsloth/Llama-3.3-70B-Instruct-bnb-4bit

Text Generation • Updated Jan 7 • 269k • 32

unsloth/Qwen2-VL-2B-bnb-4bit

Image-Text-to-Text • Updated Dec 6, 2024 • 104 • 1

mjschock/SmolVLM-Instruct

Image-Text-to-Text • Updated Dec 25, 2024 • 91 • 2

unsloth/QVQ-72B-Preview-bnb-4bit

Image-Text-to-Text • Updated Dec 25, 2024 • 558 • 4

PrunaAI/HuggingFaceTB-SmolLM2-1.7B-Instruct-bnb-4bit-smashed

Updated Dec 25, 2024 • 12 • 1

Daemontatox/EyeofHorus

Image-Text-to-Text • Updated Dec 26, 2024 • 15 • 1

PrunaAI/bunnycore-Llama-3.2-3B-RP-DeepThink-bnb-8bit-smashed

Updated Dec 27, 2024 • 21 • 1

PrunaAI/codenamics-Llama-3.2-3B-Instruct-Finance-RAG-bnb-8bit-smashed

Updated Dec 28, 2024 • 16 • 1

danielhanchen/cosy-05-qwen-unsloth-bnb-4bit

Text Generation • Updated Dec 29, 2024 • 81 • 1