GPTQ Quants - a thesven Collection

thesven 's Collections

GPTQ Quants

updated Sep 13, 2024

thesven/Mistral-7B-Instruct-v0.3-GPTQ

Text Generation • Updated Sep 11, 2024 • 6.36k
thesven/Phi-3.5-mini-instruct-GPTQ-4bit

Text Generation • Updated Aug 29, 2024 • 172
thesven/Phi-nut-Butter-Codebagel-v1-GPTQ

Text Generation • Updated May 26, 2024 • 16
thesven/Aether-Qwen2-0.5B-SFT-v0.0.2-GPTQ

Text Generation • Updated Jun 13, 2024 • 137
thesven/microsoft_WizardLM-2-7B-GPTQ

Text Generation • Updated May 25, 2024 • 87
thesven/prometheus-7b-v2.0-GPTQ

Text2Text Generation • Updated May 31, 2024 • 13
thesven/Meta-Llama-3.1-8B-Instruct-GPTQ

Text Generation • Updated Jul 23, 2024 • 572
thesven/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 16, 2024 • 80
thesven/Mistral-7B-v0.3-GPTQ

Text Generation • Updated May 25, 2024 • 94
thesven/openchat-3.6-8b-20240522-GPTQ

Text Generation • Updated May 25, 2024 • 85
thesven/Llama-3-8B-GPTQ-4bit

Text Generation • Updated May 13, 2024 • 1.73k
thesven/microsoft_WizardLM-2-7B-GPTQ-98k

Text Generation • Updated May 25, 2024 • 83
thesven/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Aug 2, 2024 • 83
thesven/falcon-11B-GPTQ-4bit

Text Generation • Updated May 14, 2024 • 113