Edit Models filters

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,007

Full-text search

Active filters: 8-bit

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 11 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 177 • 4

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21, 2024 • 7.19k • 26

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21, 2024 • 4.15k • 13

watsonchua/hansard-gemma-2-9b-lora

Updated Sep 2, 2024 • 2 • 1

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4, 2024 • 1.2M • 5

qeternity/Mistral-Large-Instruct-2407-w8a8

Updated Sep 7, 2024 • 4 • 1

HF1BitLLM/Llama3-8B-1.58-100B-tokens

Text Generation • Updated Sep 19, 2024 • 2.37k • 169

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13, 2024 • 1.2M • 24

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 24, 2024 • 2.19k • 10

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 37.3k • 8

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 18, 2024 • 24.1k • 12

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 4.75k • 17

MaziyarPanahi/Qwen2.5-1.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.2M • 3

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 1.22M • 9

brunopio/Llama3-8B-1.58-100B-tokens-GGUF

Text Generation • Updated Sep 19, 2024 • 1.62M • 13

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 822k • 10

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.21M • 8

qeternity/Qwen2.5-72B-Instruct-W8A8

Updated Oct 1, 2024 • 17 • 3

malenia1/ternary-weight-embedding

Updated Dec 16, 2024 • 1.26k • 5

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Oct 30, 2024 • 51 • 3

MaziyarPanahi/llm_3_2_flux_prompt-GGUF

Text Generation • Updated Nov 2, 2024 • 170 • 1

MaziyarPanahi/Llama-3.2-1B-GGUF

Text Generation • Updated Nov 2, 2024 • 98 • 1

MaziyarPanahi/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated Nov 3, 2024 • 144 • 2

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18, 2024 • 15.2k • 16

mlx-community/Qwen2.5-Coder-32B-Instruct-8bit

Text Generation • Updated Nov 11, 2024 • 169 • 8

prithivMLmods/Marco-o1-GGUF

Text Generation • Updated Dec 5, 2024 • 509 • 12

HuggingFaceTB/SmolLM2-1.7B-Instruct-Q8-mlx

Text Generation • Updated Nov 27, 2024 • 89 • 2

DrNicefellow/Qwen-QwQ-32B-Preview-8.0bpw-h8-exl2

Updated Nov 28, 2024 • 14 • 3

tiiuae/Falcon3-7B-Instruct-1.58bit

Text Generation • Updated 24 days ago • 3.68k • 13