Edit Models filters

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

120,145

Full-text search

Active filters: conversational

Infermatic/72B-Qwen2.5-Kunou-v1-FP8-Dynamic

Text Generation • Updated 23 days ago • 228 • 1

bartowski/L3.3-70B-Euryale-v2.3-GGUF

Text Generation • Updated Dec 10, 2024 • 1.68k • 5

InferenceIllusionist/MilkDropLM-32b-v0.3

Text Generation • Updated Dec 20, 2024 • 16 • 6

scb10x/typhoon2-qwen2vl-7b-vision-instruct

Text Generation • Updated Dec 20, 2024 • 1.58k • 8

THUDM/VisionReward-Video

Text Generation • Updated Jan 1 • 647 • 4

bartowski/DeepSeek-V2.5-1210-GGUF

Text Generation • Updated Dec 11, 2024 • 4k • 11

mradermacher/QwQ-32B-Preview-abliterated-Self-instruct-4x-TIES-MGS-v1.0-i1-GGUF

Updated Dec 11, 2024 • 254 • 2

OpenGVLab/PVC-InternVL2-8B

Image-Text-to-Text • Updated Dec 17, 2024 • 23 • 9

mradermacher/Mag-Mell-R1-21B-i1-GGUF

Updated Dec 11, 2024 • 855 • 2

lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated 23 days ago • 914 • 6

mlx-community/DeepSeek-V2.5-1210-4bit

Text Generation • Updated Dec 11, 2024 • 72 • 3

aisingapore/llama3.1-8b-cpt-sea-lionv3-instruct

Text Generation • Updated Dec 19, 2024 • 4.46k • 3

aisingapore/llama3.1-70b-cpt-sea-lionv3-instruct

Text Generation • Updated Dec 19, 2024 • 339 • 1

aovchinnikov/T-lite-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 154 • 5

mradermacher/QwQ-32B-Instruct-abliterated-i1-GGUF

Updated Dec 12, 2024 • 273 • 1

maxidl/Llama-OpenReviewer-8B

Text Generation • Updated Dec 13, 2024 • 137 • 4

Kendamarron/LongWriter-llm-jp-3-3.7b-instruct

Text Generation • Updated Dec 11, 2024 • 83 • 5

mlfoundations-dev/oh-dcft-v3.1-claude-3-5-haiku-20241022

Text Generation • Updated Dec 12, 2024 • 105 • 4

bartowski/Hermes-3-Llama-3.2-3B-GGUF

Text Generation • Updated Dec 11, 2024 • 1.39k • 5

parasail-ai/VLM2Vec-LLaVa-Next-vllm

Image-Text-to-Text • Updated Dec 11, 2024 • 240 • 2

ggml-org/Qwen2.5-Coder-1.5B-32B-speculative-GGUF

Text Generation • Updated Dec 11, 2024 • 44 • 3

kenhktsui/llama3.1-8b-instruct-thinking-sft-merged-gguf

Updated Dec 30, 2024 • 24 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF

Updated Dec 11, 2024 • 10 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 11, 2024 • 26 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF

Updated Dec 11, 2024 • 13 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF

Updated Dec 12, 2024 • 12 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF

Updated Dec 12, 2024 • 15 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 9 • 1

mradermacher/Llama-3-14B-Instruct-v1-GGUF

Updated Dec 12, 2024 • 247 • 1

DavidAU/Llama-3.2-4X3B-MOE-Ultra-Instruct-10B-GGUF

Text Generation • Updated Dec 20, 2024 • 953 • 3