Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference Providers
Select all
Replicate
SambaNova
Together AI
fal
HF Inference API
Misc
Reset Misc
4-bit precision
text-generation-inference
4-bit precision
AutoTrain Compatible
Inference Endpoints
Misc with no match
Eval Results
Merge
8-bit precision
custom_code
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
13
Full-text search
Edit filters
Sort: Trending
Active filters:
4-bit precision
Clear all
Esperanto/mistral-7b-Instruct-v0.2-kvc-AWQ-int4-onnx
Updated
Dec 12, 2024
•
5
•
1
cmod/firefunction-v1-GGUF
Updated
Feb 25, 2024
Esperanto/gemma-2b-it-kvc-AWQ-int4-onnx
Updated
Dec 12, 2024
•
6
Esperanto/gemma-7b-it-kvc-AWQ-int4-onnx
Updated
Dec 12, 2024
•
1
Esperanto/phi3-mini-4k-instruct-kvc-AWQ-int4-onnx
Updated
Dec 12, 2024
•
2
amornpan/openthaigpt-MedChatModelv11
Text Generation
•
Updated
Nov 3, 2024
•
33
•
2
Esperanto/llama-3.2-3B-Instruct-kvc-AWQ-int4-onnx
Text Generation
•
Updated
Dec 12, 2024
•
12
Esperanto/llama-3.2-1B-Instruct-kvc-AWQ-int4-onnx
Text Generation
•
Updated
Dec 12, 2024
•
1
Esperanto/llama3.1-8b-Instruct-kvc-AWQ-int4-onnx
Text Generation
•
Updated
Dec 12, 2024
•
3
Esperanto/mistral-7b-kvc-AWQ-int4-onnx
Updated
Dec 18, 2024
•
4
amornpan/openthaigpt1.5-14b-MedChatModelV1
Text Generation
•
Updated
Nov 4, 2024
•
33
•
1
akkikiki/j-moshi-ext-mlx-q4
Updated
3 days ago
•
97
ruslanmv/granite-3.1-2b-Reasoning-4bit
Text Generation
•
Updated
3 days ago
•
7