unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit
Text Generation
•
Updated
•
55.9k
•
13
Unsloth 4-bit Dynamic Quants
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
Note DeepSeek-R1 Distill Models:
-
unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit
Text Generation • Updated • 12.1k • 12 -
unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit
Text Generation • Updated • 11.6k • 4
unsloth/phi-4-unsloth-bnb-4bit
Text Generation • Updated • 78.3k • 39Note Text-based LLMs:
-
unsloth/Mistral-Small-24B-Instruct-2501-unsloth-bnb-4bit
Text Generation • Updated • 3.73k • 7 -
unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 29 -
unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 43.6k • 3 -
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 15.9k • 1 -
unsloth/Mistral-Small-24B-Base-2501-unsloth-bnb-4bit
Text Generation • Updated • 686
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 66.6k • 20Note Vision Models:
-
unsloth/Qwen2.5-VL-7B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 1.88k • 7 -
unsloth/Qwen2.5-VL-72B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 458 • 1 -
unsloth/Qwen2.5-VL-3B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 615 -
unsloth/Qwen2-VL-7B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 37.9k • 9 -
unsloth/Qwen2-VL-2B-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 16.6k • 5 -
unsloth/Pixtral-12B-2409-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 3.76k • 5 -
unsloth/Llama-3.2-11B-Vision-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 1.21k • 3 -
unsloth/QwQ-32B-Preview-unsloth-bnb-4bit
Text Generation • Updated • 937 • 18 -
unsloth/Qwen2.5-3B-Instruct-unsloth-bnb-4bit
Text Generation • Updated • 1