Edit Models filters

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,915

Full-text search

Active filters: awq

Rui1283/llama3_8b-instruct-w4-g128

Text Generation • Updated Jul 19, 2024 • 12

PrunaAI/aloobun-Cypher-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 75

PrunaAI/Sao10K-L3-8B-Stheno-v3.2-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 82

infly/INF-34B-Chat-AWQ

Text Generation • Updated Jul 25, 2024 • 4 • 3

PrunaAI/AI-MO-NuminaMath-7B-TIR-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 77

Ichigo2899/mistralai-Mistral-Nemo-Instruct-2407-AWQ

Text Generation • Updated Jul 18, 2024 • 105 • 1

PrunaAI/keeeeenw-MicroLlama-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 261

PrunaAI/unsloth-gemma-7b-it-AWQ-4bit-smashed

Text Generation • Updated Jul 18, 2024 • 75

PrunaAI/sethuiyer-Medichat-Llama3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 75

hsan512/vistral_lora_merged_ver3-awq

Text Generation • Updated Jul 19, 2024 • 77

linl03/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/abacaj-llama-161M-100B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/dmis-lab-meerkat-7b-v1.0-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 6

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 602k • 62

PrunaAI/h2oai-h2o-danube3-500m-base-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 3

PrunaAI/amazon-MegaBeam-Mistral-7B-300k-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/sail-Sailor-0.5B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/unsloth-Phi-3-medium-4k-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 3

PrunaAI/unsloth-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/ChaoticNeutrals-Poppy_Porpoise-v0.7-L3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 5

PrunaAI/cognitivecomputations-dolphin-2.9.3-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/Vikhrmodels-Vikhr-7B-instruct_0.4-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/HuggingFaceTB-SmolLM-1.7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 3

PrunaAI/01-ai-Yi-6B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 3

PrunaAI/flammenai-Mahou-1.2-llama3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 2

broyal/gemma-7b-AWQ

Text Generation • Updated Jul 19, 2024 • 3

PrunaAI/ajibawa-2023-Code-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/nayohan-llama3-instrucTrans-enko-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

PrunaAI/instructlab-merlinite-7b-lab-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 4

google/gemma-7b-AWQ

Text Generation • Updated Jul 23, 2024 • 20