Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

4,269

Full-text search

Active filters: chat

blotfaba/Qwen-2.5-72B-Instruct-abliterated-v2-Q6_K.gguf

Text Generation • Updated Nov 27, 2024 • 55

tensorblock/Qwen2.5-Coder-32B-Instruct-abliterated-GGUF

Text Generation • Updated Nov 27, 2024 • 72

neuralmagic/Qwen2.5-0.5B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 30

cgus/Qwen2.5-0.5B-Instruct-exl2

Text Generation • Updated Nov 29, 2024 • 32

neuralmagic/Qwen2.5-1.5B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 19

neuralmagic/Qwen2.5-3B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 46

neuralmagic/Qwen2.5-7B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 21

nanowell/QwQ-32B-Preview-Q4_K_M-GGUF

Text Generation • Updated Nov 27, 2024 • 7 • 7

orabazes/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 27, 2024 • 6 • 2

tensorblock/leniachat-qwen2-1.5B-v0-GGUF

Updated Nov 27, 2024 • 14

mlx-community/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 27, 2024 • 88 • 3

mlx-community/QwQ-32B-Preview-3bit

Text Generation • Updated Nov 28, 2024 • 31 • 5

mlx-community/QwQ-32B-Preview-6bit

Text Generation • Updated Nov 27, 2024 • 84 • 4

mlx-community/QwQ-32B-Preview-8bit

Text Generation • Updated Nov 27, 2024 • 79 • 5

mlx-community/QwQ-32B-Preview-bf16

Text Generation • Updated Nov 27, 2024 • 88 • 5

sbeltz/QwQ-32B-Preview-Q3_K_S-GGUF

Text Generation • Updated Nov 27, 2024 • 7 • 3

Beygo/QwQ-32B-Preview-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 7 • 1

ashercn97/QwQ-32B-Preview-Q2_K-GGUF

Text Generation • Updated Nov 27, 2024 • 2

ivanfioravanti/QwQ-32B-Preview-4bit

Text Generation • Updated Nov 27, 2024 • 26 • 2

async0x42/QwQ-32B-Preview-exl2_4.0bpw

Text Generation • Updated Nov 29, 2024 • 5

mradermacher/SD-Prompter-1.5B-V0.1-GGUF

Updated Nov 28, 2024 • 149 • 1

mradermacher/SD-Prompter-1.5B-V0.1-i1-GGUF

Updated Nov 28, 2024 • 150 • 1

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-EXL2

Text Generation • Updated Nov 30, 2024 • 164

ThomasBaruzier/Qwen2.5-Coder-32B-Instruct-GGUF

Text Generation • Updated about 9 hours ago • 505

bartowski/QwQ-32B-Preview-exl2

Text Generation • Updated Nov 28, 2024 • 14 • 13

mradermacher/QwQ-32B-Preview-i1-GGUF

Updated Dec 12, 2024 • 164 • 1

neuralmagic/Qwen2.5-72B-FP8-dynamic

Text Generation • Updated Dec 3, 2024 • 21

apto-as/Qwen2.5-0.5B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 28, 2024 • 4

apto-as/Qwen2.5-Coder-14B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 28, 2024 • 3

second-state/QwQ-32B-Preview-GGUF

Text Generation • Updated Nov 28, 2024 • 74