Edit Models filters

Inference Providers

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

4,787

Full-text search

Active filters: exl2

waldie/DeepSeek-R1-Distill-Qwen-32B-4bpw-h6-exl2

Updated 22 days ago • 412 • 6

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated 12 days ago • 82

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_4.0bpw_H8

Text Generation • Updated 17 days ago • 152 • 4

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_5.0bpw_H8

Text Generation • Updated 16 days ago • 121 • 2

Natkituwu/Erosumika-7B-v3-7.1bpw-exl2

Text Generation • Updated Mar 26, 2024 • 14 • 1

LoneStriker/dolphin-2.9-llama3-70b-5.0bpw-h6-exl2

Text Generation • Updated Apr 25, 2024 • 9.68k • 3

DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal

Text Generation • Updated May 19, 2024 • 14 • 1

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 24 • 2

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 89 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 94 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 87 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 93 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 89 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 17 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 8 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 12 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 9 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 9 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 180 • 4

Statuo/NemoMix-Unleashed-EXL2-4bpw

Text Generation • Updated Aug 23, 2024 • 90 • 8

riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Updated Sep 9, 2024 • 8 • 3

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 111 • 20

NeoChen1024/dolphin-2.9.3-mistral-nemo-12b-exl2-4.0bpw-h8

Updated Oct 3, 2024 • 17 • 1