Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,914

Full-text search

Active filters: awq

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 4 days ago • 14.2k • 19

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated 7 days ago • 2.07k • 6

Valdemardi/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 17 days ago • 12.8k • 12

casperhansen/mistral-small-24b-instruct-2501-awq

Updated 7 days ago • 2.49k • 5

Valdemardi/DeepSeek-R1-Distill-Llama-70B-AWQ

Text Generation • Updated 17 days ago • 21.6k • 8

casperhansen/deepseek-r1-distill-qwen-14b-awq

Updated 17 days ago • 4.57k • 7

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 90 • 5

ibnzterrell/Meta-Llama-3.3-70B-Instruct-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 25.1k • 18

cognitivecomputations/DeepSeek-V3-AWQ

Text Generation • Updated 4 days ago • 4.99k • 15

inarikami/DeepSeek-R1-Distill-Qwen-32B-AWQ

Text Generation • Updated 14 days ago • 72k • 3

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 60 • 3

TheBloke/Wizard-Vicuna-7B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 103 • 7

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 1.53k • 30

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 119 • 35

MohamedRashad/AceGPT-13B-chat-AWQ

Text Generation • Updated Nov 18, 2023 • 57 • 3

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 115 • 1

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 43k • 43

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 95 • 3

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 15.2k • 22

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 943 • 20

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 703k • 3

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 82 • 1

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 215 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 52 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 200 • 1

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 78 • 1

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 307k • 96

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 40.5k • 9

solidrust/Meta-Llama-3.1-8B-Instruct-abliterated-AWQ

Text Generation • Updated Sep 3, 2024 • 341 • 3

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 77.4k • 45