Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,216

Full-text search

Active filters: 4-bit

Pi3141/alpaca-7b-native-enhanced-GPTQ

Text Generation • Updated Dec 3, 2023 • 2

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 36.8k • 43

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • Updated Dec 16, 2023 • 7.56k • 4

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 161 • 110

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 17 • 5

TheBloke/GEITje-7B-chat-GPTQ

Text Generation • Updated Dec 19, 2023 • 36 • 4

unsloth/mistral-7b-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 19.2k • 25

unsloth/codellama-34b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 543 • 4

unsloth/llama-2-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 466 • 5

unsloth/zephyr-sft-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 12.6k • 5

unsloth/tinyllama-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 6.85k • 11

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 284 • 2

unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 12.2k • 32

unsloth/mistral-7b-instruct-v0.1-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 636 • 4

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 1.61k • 3

unsloth/llama-2-7b-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.14k • 2

unsloth/codellama-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.95k • 3

unsloth/codellama-13b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 84 • 2

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 134 • 5

unsloth/yi-34b-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 20 • 3

unsloth/yi-34b-chat-bnb-4bit

Text Generation • Updated Mar 22, 2024 • 26 • 2

unsloth/tinyllama-chat-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 11.4k • 4

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 1.73k • 29

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 94 • 3

unsloth/gemma-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.77k • 18

unsloth/gemma-2b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.25k • 16

unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 1.31k • 20

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 9.43k • 14

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 106 • 3

MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF

Text Generation • Updated Feb 28, 2024 • 248 • 8