Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,915

Full-text search

Active filters: awq

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 7.6k • 20

Qwen/Qwen2-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 64.4k • 44

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 2.92k • 6

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 13.5k • 17

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 32.7k • 55

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 852k • 54

solidrust/Gemma-2-Ataraxy-9B-AWQ

Text Generation • Updated Sep 20, 2024 • 119 • 1

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 918 • 3

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 41.5k • 21

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated 26 days ago • 16.2k • 6

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 407k • 23

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated Nov 29, 2024 • 1.06k • 6

OPEA/QwQ-32B-Preview-int4-sym-mixed-awq-inc

Updated Dec 23, 2024 • 46 • 1

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 62.8k • 27

lambdalabs/Llama-3.3-70B-Instruct-AWQ-4bit

Updated Dec 10, 2024 • 1.59k • 3

casperhansen/qwq-32b-preview-awq

Updated Dec 15, 2024 • 80 • 1

RichardErkhov/zake7749_-_Llama-3.2-1B-it-chinese-kyara-awq

Updated Dec 22, 2024 • 5 • 1

kosbu/QVQ-72B-Preview-AWQ

Image-Text-to-Text • Updated Dec 25, 2024 • 1.18k • 7

OPEA/DeepSeek-V3-int4-sym-awq-inc-cpu

Updated 23 days ago • 113 • 2

internlm/internlm3-8b-instruct-awq

Text Generation • Updated 22 days ago • 465 • 3

PrunaAI/djuna-Q2.5-Veltha-14B-0.5-AWQ-4bit-smashed

Updated 16 days ago • 27 • 1

casperhansen/deepseek-r1-distill-qwen-1.5b-awq

Updated 17 days ago • 524 • 1

casperhansen/deepseek-r1-distill-qwen-32b-awq

Updated 17 days ago • 6.91k • 5

casperhansen/deepseek-r1-distill-llama-70b-awq

Updated 17 days ago • 3.52k • 10

Valdemardi/FuseO1-DeepSeekR1-QwQ-SkyT1-32B-Preview-AWQ

Text Generation • Updated 14 days ago • 792 • 3

v2ray/GPT4chan-24B-AWQ

Text Generation • Updated 1 day ago • 6 • 1

casperhansen/mpt-7b-8k-chat-awq

Text Generation • Updated Nov 4, 2023 • 21 • 3

casperhansen/falcon-7b-awq

Text Generation • Updated Nov 4, 2023 • 32 • 1

casperhansen/vicuna-7b-v1.5-awq

Text Generation • Updated Oct 31, 2023 • 25 • 3

casperhansen/vicuna-7b-v1.5-awq-gemv

Text Generation • Updated Oct 31, 2023 • 21 • 1