Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

229

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8, 2024 • 78.8k • 111

unsloth/Llama-3.2-3B-Instruct-unsloth-bnb-4bit

Text Generation • Updated 6 days ago • 43.6k • 3

hugging-quants/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 22.2k • 44

lmstudio-community/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 23 days ago • 10.4k • 32

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated 15 days ago • 246k • 17

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 822k • 10

neuralmagic/Llama-3.2-3B-Instruct-FP8

Text Generation • Updated Oct 16, 2024 • 13k • 4

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1, 2024 • 90 • 4

spxiong/Llama-3.2-3B-Chinese-Instruct

Text Generation • Updated Nov 11, 2024 • 292 • 4

nvidia/Meta-Llama-3.2-3B-Instruct-ONNX-INT4

Updated Nov 15, 2024 • 7

mkurman/llama-3.2-MEDIT-3B-o1

Text Generation • Updated 30 days ago • 607 • 12

pankajmathur/orca_mini_v9_6_3B-Instruct-GGUF

Updated 14 days ago • 186 • 1

unsloth/Llama-3.2-3B-unsloth-bnb-4bit

Text Generation • Updated 13 days ago • 7.29k • 1

onnx-community/Llama-3.2-3B-Instruct

Text Generation • Updated Oct 8, 2024 • 127 • 10

hugging-quants/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 931 • 19

mlx-community/Llama-3.2-3B-Instruct-4bit

Text Generation • Updated Sep 25, 2024 • 889k • 26

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 25, 2024 • 7 • 1

paultimothymooney/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25, 2024 • 11

mlc-ai/Llama-3.2-3B-Instruct-q0f16-MLC

Updated Sep 25, 2024 • 5

mlc-ai/Llama-3.2-3B-Instruct-q4f16_1-MLC

Updated Sep 25, 2024 • 1.49k • 4

mlc-ai/Llama-3.2-3B-Instruct-q0f32-MLC

Updated Sep 25, 2024 • 1

bartowski/Llama-3.2-3B-Instruct-exl2

Text Generation • Updated Oct 8, 2024 • 59 • 5

mlc-ai/Llama-3.2-3B-Instruct-q4f32_1-MLC

Updated Sep 25, 2024 • 2.04k • 2

neuralmagic/Llama-3.2-3B-Instruct-FP8-dynamic

Text Generation • Updated Oct 9, 2024 • 1.39k • 2

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25, 2024 • 599 • 1

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16, 2024 • 7.24k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 83

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Dec 29, 2024 • 12.6k • 2

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 3.6k • 1

baslak/Llama-3.2-3B-Instruct-ONNX-Q4

Updated Sep 25, 2024 • 4