Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

23,868

Full-text search

Active filters: 4-bit

MaziyarPanahi/Llama-3-8B-Instruct-32k-v0.1-GGUF

Text Generation • Updated Jun 28, 2024 • 1.33M • 57

unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 42.3k • 29

Lokesh477/healthcare_llm

Text Generation • Updated May 14, 2024 • 174 • 1

unsloth/mistral-7b-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 25.5k • 15

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 96.5k • 18

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10, 2024 • 1.34k • 18

allganize/Llama-3-Alpha-Ko-8B-Instruct-marlin

Text Generation • Updated May 24, 2024 • 16 • 5

unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 4.58k • 5

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24, 2024 • 1.22k • 28

sdasd112132/Vision-8B-MiniCPM-2_5-Uncensored-and-Detailed-4bit

Visual Question Answering • Updated Jun 1, 2024 • 568 • 26

Intel/Qwen2-7B-int4-inc

Text Generation • Updated Oct 24, 2024 • 143 • 6

SeacomSrl/SeaPhi3-medium

Text Generation • Updated Jul 15, 2024 • 5.49k • 4

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21, 2024 • 2.25k • 24

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 943 • 20

unsloth/Qwen2-1.5B-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 1.77k • 1

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6, 2024 • 1.19M • 11

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 703k • 3

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 85 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 1.2M • 16

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 203 • 1

PrunaAI/llmware-bling-phi-3-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 110 • 1

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 82 • 1

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 46.1k • 26

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.82k • 14

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 87.9k • 23

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 215 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 52 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 200 • 1

mac999/Llama3-8B-BIM

Text Generation • Updated Jul 11, 2024 • 8 • 1

pentagoniac/SEMIKONG-8b-GPTQ

Text Generation • Updated Jul 9, 2024 • 912 • 26