Edit Models filters

Inference Providers

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,197

Full-text search

Active filters: gptq

nejumi/phi-4-GPTQ-Int4-calib-ja-1k

Updated 24 days ago • 164 • 3

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • Updated 23 days ago • 17.2k • 37

ModelCloud/Qwen2.5-0.5B-Instruct-gptqmodel-4bit

Text Generation • Updated 29 days ago • 92 • 1

jakiAJK/DeepSeek-R1-Distill-Qwen-7B_GPTQ-int4

Text Generation • Updated 24 days ago • 638 • 2

kaitchup/DeepSeek-R1-Distill-Qwen-7B-AutoRound-GPTQ-4bit

Text Generation • Updated 18 days ago • 309 • 1

kaitchup/DeepSeek-R1-Distill-Llama-8B-AutoRound-GPTQ-4bit

Text Generation • Updated 18 days ago • 160 • 1

kaitchup/DeepSeek-R1-Distill-Qwen-14B-AutoRound-GPTQ-4bit

Text Generation • Updated 18 days ago • 787 • 4

nejumi/DeepSeek-R1-Distill-Qwen-32B-GPTQ-Int4-calib-ja-1k

Updated 23 days ago • 309 • 2

jakiAJK/DeepSeek-R1-Distill-Qwen-1.5B_GPTQ-int4

Text Generation • Updated 23 days ago • 464 • 1

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v1

Text Generation • Updated 21 days ago • 490 • 5

adriabama06/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-8bit

Text Generation • Updated 23 days ago • 640 • 1

avoroshilov/DeepSeek-R1-Distill-Qwen-14B-GPTQ_4bit-128g

Text Generation • Updated 20 days ago • 177 • 1

ModelCloud/DeepSeek-R1-Distill-Qwen-7B-gptqmodel-4bit-vortex-v2

Text Generation • Updated 21 days ago • 574 • 4

TheBloke/Nete-13B-GPTQ

Text Generation • Updated Oct 27, 2023 • 72 • 6

TheBloke/Utopia-13B-GPTQ

Text Generation • Updated Nov 5, 2023 • 107 • 12

TheBloke/UtopiaXL-13B-GPTQ

Text Generation • Updated Nov 6, 2023 • 33 • 7

TheBloke/Llamix2-MLewd-4x13B-GPTQ

Text Generation • Updated Dec 15, 2023 • 39 • 8

TheBloke/Silicon-Maid-7B-GPTQ

Text Generation • Updated Dec 27, 2023 • 479 • 23

elinas/alpaca-13b-lora-int4

Text Generation • Updated Apr 5, 2023 • 27 • 41

elinas/alpaca-30b-lora-int4

Text Generation • Updated Apr 5, 2023 • 30 • 68

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 45 • 39

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 56 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 13 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 12 • 2

elinas/vicuna-13b-4bit

Text Generation • Updated Apr 5, 2023 • 25 • 46

TheBloke/koala-7B-GPTQ

Text Generation • Updated Aug 21, 2023 • 142 • 31

TheBloke/koala-13B-HF

Text Generation • Updated Jun 5, 2023 • 3.62k • 41

TheBloke/koala-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 47 • 38

TheBloke/galpaca-30B-GPTQ

Text Generation • Updated Aug 21, 2023 • 20 • 48

Ancestral/Dolly_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 32 • 5