Edit Models filters

Inference Providers

HF Inference API

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

90

Full-text search

Active filters: 7-bit

DrNicefellow/Qwen-QwQ-32B-Preview-7.0bpw-exl2

Updated Nov 28, 2024 • 7

Dracones/Qwen2.5-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024 • 7

Dracones/Qwen2.5-Coder-32B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 1, 2024 • 6

Dracones/Athene-V2-Chat_exl2_7.0bpw

Text Generation • Updated Dec 15, 2024 • 10

Dracones/Llama-3.1-Nemotron-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 8

Dracones/Qwen2.5-72B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 2, 2024 • 7

Dracones/QwQ-32B-Preview_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024 • 10

BigHuggyD/TheDrummer_Behemoth-123B-v1.2_exl2_7.0bpw_h8

Updated Dec 3, 2024 • 4

Dracones/Evathene-v1.3_exl2_7.0bpw

Text Generation • Updated Dec 3, 2024 • 7

SicariusSicariiStuff/Impish_Mind_8B-7.0bpw

Updated Dec 5, 2024 • 4

DrNicefellow/QwQ-32B-Preview-abliterated-7.0bpw-exl2

Updated Dec 6, 2024 • 5

Dracones/Llama-3.3-70B-Instruct_exl2_7.0bpw

Text Generation • Updated Dec 7, 2024 • 7

Dracones/L3.3-70B-Euryale-v2.3_exl2_7.0bpw

Text Generation • Updated Dec 10, 2024 • 6

Dracones/EVA-LLaMA-3.33-70B-v0.0_exl2_7.0bpw

Text Generation • Updated Dec 12, 2024 • 8

Dracones/72B-Qwen2.5-Kunou-v1_exl2_7.0bpw

Text Generation • Updated Dec 17, 2024 • 8

ReadyArt/Skyfall-39B_EXL2_7.0bpw_H8

Updated Dec 17, 2024 • 11

ReadyArt/Anubis-70B-v1_EXL2_7.0bpw_H8

Updated Dec 22, 2024 • 13

Dracones/Anubis-70B-v1_exl2_7.0bpw

Text Generation • Updated Dec 25, 2024 • 21

Dracones/QVQ-72B-Preview_exl2_7.0bpw

Image-Text-to-Text • Updated Dec 26, 2024 • 13

Dracones/Evayale-v1.0_exl2_7.0bpw

Text Generation • Updated Jan 6 • 7

SicariusSicariiStuff/Negative_LLAMA_70B-7.0bpw

Updated Jan 12 • 7

SicariusSicariiStuff/Eximius_Persona_5B-7.0bpw

Updated 23 days ago • 8

sleepdeprived3/Sto-vo-kor-12B_EXL2_7bpw_H8

Updated 23 days ago • 6

SicariusSicariiStuff/Wingless_Imp_8B-7.0bpw

Updated 21 days ago • 7

PedroPareja/DeepSeek-R1-Distill-Qwen-32B-7bpw-h8-exl2

Text Generation • Updated 19 days ago • 108

sleepdeprived3/UnslopNemo-12B-v3_7bpw_H8

Text Generation • Updated 19 days ago • 15

SicariusSicariiStuff/Impish_QWEN_14B-1M-7.0bpw

Updated 18 days ago • 5

sleepdeprived3/Cydonia-22B-v1_EXL2_7bpw_H8

Updated 15 days ago • 8

Dracones/L3.3-Nevoria-R1-70b_exl2_7.0bpw

Text Generation • Updated 15 days ago • 23

SicariusSicariiStuff/Phi-lthy4-7.0bpw

Updated 1 day ago • 1