Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,263

Full-text search

Active filters: chat

QuantFactory/SD-Prompter-1.5B-V0.1-GGUF

Updated Nov 29, 2024 • 628 • 3

shashikanth-a/tinyllama-chat-4bit

Text Generation • Updated Nov 28, 2024 • 77

shashikanth-a/llama-2-7b-chat-4bit

Text Generation • Updated Nov 28, 2024 • 86

AIR-hl/Llama-3.2-1B-DPO

Text Generation • Updated Dec 24, 2024 • 153

mlx-community/Qwen_QwQ-32B-Preview_MLX-8bit

Text Generation • Updated Nov 28, 2024 • 24 • 4

tensorblock/ghost-8b-beta-GGUF

Text Generation • Updated Nov 28, 2024 • 35 • 1

mradermacher/Llama-3.2-1B-DPO-GGUF

Updated Nov 28, 2024 • 20

abalogh/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 28, 2024 • 10

mlx-community/Qwen_QwQ-32B-Preview_MLX-4bit

Text Generation • Updated Nov 28, 2024 • 25 • 1

DrNicefellow/Qwen-QwQ-32B-Preview-4.25bpw-exl2

Text Generation • Updated Nov 28, 2024 • 8 • 3

tensorblock/calme-2.8-qwen2-7b-GGUF

Text Generation • Updated Nov 28, 2024 • 53

async0x42/QwQ-32B-Preview-exl2_3.5bpw

Text Generation • Updated Nov 29, 2024 • 8

tensorblock/magnum-v2-12b-GGUF

Text Generation • Updated Nov 28, 2024 • 23

async0x42/QwQ-32B-Preview-exl2_4.5bpw

Text Generation • Updated Nov 29, 2024 • 6 • 1

deltanym/QwQ-32B-Preview-abliterated-Q5_K_M-GGUF

Text Generation • Updated Nov 28, 2024 • 14

waltervix/QwQ-32B-Preview-Q2_K-GGUF

Text Generation • Updated Nov 29, 2024 • 3

deltanym/QwQ-32B-Preview-abliterated-Q4_K_M-GGUF

Text Generation • Updated Nov 29, 2024 • 8 • 2

Hack337/QwQ-32B-Preview-abliterated-Q3_K_S-GGUF

Text Generation • Updated Nov 29, 2024 • 1

async0x42/QwQ-32B-Preview-exl2_5.0bpw

Text Generation • Updated Nov 29, 2024 • 4

DavidAU/L3.1-Instruct-Guru-8B-GGUF

Text Generation • Updated Nov 29, 2024 • 262 • 3

lmstudio-community/QwQ-32B-Preview-MLX-4bit

Text Generation • Updated Nov 29, 2024 • 4

lmstudio-community/QwQ-32B-Preview-MLX-8bit

Text Generation • Updated Nov 29, 2024 • 6

alvinrach/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 29, 2024 • 5

FelisDwan/QwQ-32B-Preview-Q2_K-GGUF

Updated Nov 29, 2024

gmonsoon/QwQ-32B-Preview-abliterated-Q4_K_M-GGUF

Text Generation • Updated Nov 29, 2024 • 12

ModelCloud/QwQ-32B-Preview-gptqmodel-4bit-vortex-v1

Text Generation • Updated Dec 18, 2024 • 34 • 51

taobao-mnn/QwQ-32B-Preview-MNN

Text Generation • Updated Dec 31, 2024 • 2

ThomasBaruzier/QwQ-32B-Preview-EXL2

Updated Nov 30, 2024

mradermacher/QwQ-32B-Coder-Fusion-9010-GGUF

Updated Nov 29, 2024 • 41 • 1

mradermacher/QwQ-32B-Preview-jackterated-GGUF

Updated Nov 30, 2024 • 20 • 1