Edit Models filters

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

10,359

Full-text search

Active filters: imatrix

anthracite-org/magnum-v2-4b-gguf

Text Generation • Updated Aug 27, 2024 • 133 • 7

mradermacher/Lyra-Gutenberg-mistral-nemo-12B-i1-GGUF

Updated Sep 16, 2024 • 421 • 2

anthracite-org/magnum-v3-34b-gguf

Text Generation • Updated Aug 28, 2024 • 35.1k • 12

bartowski/glm-4-9b-chat-GGUF

Text Generation • Updated Aug 26, 2024 • 808 • 2

mradermacher/kainaticulous-rp-7b-i1-GGUF

Updated Sep 8, 2024 • 308 • 2

backyardai/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 30, 2024 • 152 • 2

bartowski/c4ai-command-r-plus-08-2024-GGUF

Text Generation • Updated Aug 30, 2024 • 5.06k • 19

legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF

Text Generation • Updated Aug 31, 2024 • 125 • 6

mradermacher/llama-3-8b-chat-companion-assistant-i1-GGUF

Updated Aug 31, 2024 • 193 • 1

mradermacher/Star-Command-R-32B-v1-i1-GGUF

Updated Sep 8, 2024 • 94 • 4

Ffftdtd5dtft/Hermes-3-Llama-3.1-8B-IQ1_S-GGUF

Updated Sep 4, 2024 • 70 • 1

DavidAU/L3-Dark-Planet-Horror-City-8B-NEO-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 186 • 7

speakleash/Bielik-11B-v2.3-Instruct-GGUF

Text Generation • Updated Nov 26, 2024 • 3.12k • 24

bartowski/L3.1-70B-Hanami-x1-GGUF

Text Generation • Updated Sep 15, 2024 • 262 • 2

Felladrin/gguf-Q5_K_M-NanoLM-1B-Instruct-v2

Text2Text Generation • Updated Sep 16, 2024 • 108 • 1

NeoChen1024/dolphin-2.7-mixtral-8x7b-GGUF-IQ3_M

Updated Sep 17, 2024 • 14 • 1

mradermacher/MN-Halide-12b-v1.0-i1-GGUF

Updated Sep 18, 2024 • 4.21k • 3

mradermacher/L3-Dark-Planet-8B-V2-Eight-Orbs-Of-Power-i1-GGUF

Updated Sep 19, 2024 • 51 • 2

v000000/L3.1-Niitorm-8B-DPO-t0.0001-GGUFs-IMATRIX

Updated Oct 6, 2024 • 45 • 4

mradermacher/L3.1-Niitorm-8B-DPO-t0.0001-i1-GGUF

Updated Sep 20, 2024 • 218 • 3

bartowski/Llama-3_1-Nemotron-51B-Instruct-GGUF

Text Generation • Updated Jan 1 • 4.47k • 6

mradermacher/2B-ad-i1-GGUF

Updated 11 days ago • 105 • 1

mradermacher/Qwen2.5-32B-AGI-i1-GGUF

Updated Sep 26, 2024 • 227 • 1

mradermacher/Qwen2.5-14B-Instruct-abliterated-i1-GGUF

Updated Sep 26, 2024 • 2.81k • 6

DavidAU/Llama-3.2-3B-Instruct-NEO-SI-FI-GGUF

Text Generation • Updated Nov 14, 2024 • 623 • 6

alfredplpl/llm-jp-3-3.7b-instruct-gguf

Updated Oct 3, 2024 • 116 • 7

mradermacher/Llama-3.2-3B-Instruct-uncensored-i1-GGUF

Updated Sep 28, 2024 • 1.99k • 7

bartowski/Replete-LLM-V2.5-Qwen-32b-GGUF

Text Generation • Updated Oct 25, 2024 • 2.42k • 24

bartowski/CalmeRys-78B-Orpo-v0.1-GGUF

Text Generation • Updated Sep 30, 2024 • 495 • 6

alfredplpl/gemma-2-baku-2b-it-gguf

Updated Dec 18, 2024 • 866 • 8