Edit Models filters

Misc

Inference Endpoints

text-generation-inference

Mixture of Experts

4-bit precision

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

10,356

Full-text search

Active filters: imatrix

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14, 2024 • 2.96k • 13

mradermacher/Big-Tiger-Gemma-27B-v1-i1-GGUF

Updated Aug 2, 2024 • 522 • 1

nisten/llamagnific-3-87b-gguf

Updated Jul 17, 2024 • 71 • 10

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2, 2024 • 1.38k • 8

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2, 2024 • 1.94k • 7

bartowski/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 5.43k • 61

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 1.2M • 16

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29, 2024 • 1.22M • 38

lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Jul 25, 2024 • 6.68k • 5

mradermacher/DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 2.22k • 12

mradermacher/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-i1-GGUF

Updated Aug 2, 2024 • 277 • 3

mradermacher/Sekhmet_Bet-L3.1-8B-v0.2-i1-GGUF

Updated 1 day ago • 172 • 1

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • Updated Jul 31, 2024 • 31.5k • 21

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • Updated Jul 31, 2024 • 160 • 2

mradermacher/Rude-Assistant-Mistral-Nemo-2407-SFT-i1-GGUF

Updated 16 days ago • 114 • 1

mradermacher/shieldgemma-9b-i1-GGUF

Updated Aug 1, 2024 • 83 • 1

mradermacher/Evolved-Mistral-7B-i1-GGUF

Updated Aug 1, 2024 • 8 • 1

Felladrin/gguf-sharded-LaMini-Flan-T5-248M

Text2Text Generation • Updated Aug 5, 2024 • 62 • 1

anthracite-org/magnum-v2-12b-gguf

Text Generation • Updated Aug 22, 2024 • 4.04k • 36

bartowski/Trinity-2-Codestral-22B-GGUF

Text Generation • Updated Aug 8, 2024 • 268 • 8

mradermacher/Tess-3-Mistral-Large-2-123B-i1-GGUF

Updated Aug 10, 2024 • 31 • 2

DavidAU/Command-R-01-Ultra-NEO-DARK-HORROR-V1-V2-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 6.03k • 10

mradermacher/Roleplay-Hermes-3-Llama-3.1-8B-i1-GGUF

Updated Aug 16, 2024 • 1.38k • 3

mradermacher/Hermes-3-Llama-3.1-70B-i1-GGUF

Updated Aug 16, 2024 • 277 • 2

mradermacher/Hermes-3-Llama-3.1-8B-i1-GGUF

Updated Aug 16, 2024 • 212 • 3

legraphista/Hermes-3-Llama-3.1-8B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 274 • 1

ClaudioItaly/Hermes-3-Llama-3.1-8B-Q5_K_M-GGUF

Updated Aug 16, 2024 • 3 • 1

legraphista/Hermes-3-Llama-3.1-70B-IMat-GGUF

Text Generation • Updated Aug 16, 2024 • 179 • 1

mradermacher/nemotron-3-8b-chat-4k-sft-hf-i1-GGUF

Updated Aug 16, 2024 • 146 • 3

mradermacher/Nemo-12B-Marlin-v7-i1-GGUF

Updated Aug 17, 2024 • 287 • 2