Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

229

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

baslak/Llama-3.2-3B-Instruct-ONNX-Q4-F16

Updated Sep 25, 2024 • 4

DevQuasar/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Dec 4, 2024 • 39

MCZK/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 41 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_0-MLC

Updated Sep 26, 2024 • 6.1k

SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 4

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 26, 2024 • 1

amd/Llama-3.2-3B-Instruct-FP8-KV

Updated Dec 19, 2024 • 89

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 26, 2024 • 4 • 1

SanctumAI/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26, 2024 • 24.7k • 1

jimjimjimmyjim/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26, 2024

numen-tech/Llama-3.2-3B-Instruct-w4a16g128asym

Text Generation • Updated Sep 26, 2024

paultimothymooney/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Dec 6, 2024 • 2

brunopio/Llama-3.2-3B-Instruct-nbits4-GS64-Axis1-HQQ

Updated Sep 26, 2024 • 3

brunopio/Llama-3.2-3B-Instruct-nbits4-GSNone-Axis0-HQQ

Updated Sep 26, 2024 • 3

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26, 2024 • 7 • 1

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26, 2024 • 282 • 1

pingzhou/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26, 2024

rohanprichard/Llama-3.2-3B-Instruct-MLC

Updated Sep 27, 2024

Kondara/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Sep 27, 2024 • 28

argearriojas/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 27, 2024 • 1

mayanksharma3/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 27, 2024 • 27

BitStreamX/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 28, 2024 • 9

pipilok/Llama-3.2-3B-Instruct-Q4_0_4_8-GGUF

Text Generation • Updated Nov 1, 2024 • 34

Kondara/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28, 2024 • 4

Kondara/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 28, 2024 • 4

argearriojas/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Sep 30, 2024 • 1

CreativeWorksAi/iSA-01-Mini-3B-GGUF

Updated Oct 4, 2024 • 15

WTNLXTBL/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 2, 2024 • 1

hugger128/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 1

QuantFactory/Llama-3.2-Taiwan-Legal-3B-Instruct-GGUF

Text Generation • Updated Nov 2, 2024 • 635 • 9