Edit Models filters

Inference Providers

HF Inference API

Misc

arxiv: 2306.05685

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

217

Full-text search

Active filters: 2306.05685

RichardErkhov/SeaLLMs_-_SeaLLM-7B-v2-8bits

Text Generation • Updated May 11, 2024 • 82

RichardErkhov/SeaLLMs_-_SeaLLM-7B-v2-gguf

Updated May 11, 2024 • 223

Nanbeige/Nanbeige2-16B-Chat

Question Answering • Updated Jun 1, 2024 • 33 • 6

scb10x/llama-3-typhoon-v1.5x-70b-instruct

Text Generation • Updated May 31, 2024 • 53 • 7

scb10x/llama-3-typhoon-v1.5x-70b-instruct-awq

Text Generation • Updated May 31, 2024 • 63 • • 2

h2oai/h2o-danube2-1.8b-chat-GGUF

Text Generation • Updated May 29, 2024 • 867 • 8

taesunwhang/vicuna-7b-v1.5

Text Generation • Updated Jun 5, 2024 • 10

taesunwhang/vicuna-metamath-llemma-13b

Text Generation • Updated Jun 5, 2024 • 7

taesunwhang/vicuna-metamath-llemma-7b

Text Generation • Updated Jun 5, 2024 • 10

vicky4s4s/vicuna-7b-v1.5

Text Generation • Updated Jun 13, 2024 • 5

h2oai/h2o-danube3-4b-chat-GGUF

Text Generation • Updated Jul 4, 2024 • 888 • 21

h2oai/h2o-danube3-500m-chat-GGUF

Text Generation • Updated Jul 4, 2024 • 685 • 15

google/shieldgemma-27b

Text Generation • Updated Sep 6, 2024 • 45 • 19

ghost-x/ghost-8b-beta

Text Generation • Updated Aug 19, 2024 • 1.74k • 14

RichardErkhov/tenyx_-_TenyxChat-7B-v1-gguf

Updated Jul 24, 2024 • 3

RichardErkhov/wang7776_-_vicuna-7b-v1.3-sparsity-10-gguf

Updated Jul 25, 2024 • 9

FlorianJc/ghost-8b-beta-vllm-fp8

Text Generation • Updated Jul 25, 2024 • 13

RichardErkhov/Radiantloom_-_radiantloom-llama-70b-instruct-gguf

Updated Jul 27, 2024 • 7

QuantFactory/ghost-8b-beta-GGUF

Text Generation • Updated Jul 26, 2024 • 143 • 1

aisingapore/llama3-8b-cpt-sea-lionv2.1-instruct

Text Generation • Updated Dec 19, 2024 • 6.48k • 17

RichardErkhov/wang7776_-_vicuna-7b-v1.3-attention-sparsity-20-gguf

Updated Aug 1, 2024 • 6

RichardErkhov/scb10x_-_llama-3-typhoon-v1.5x-70b-instruct-gguf

Updated Aug 3, 2024 • 74

RichardErkhov/aisingapore_-_llama3-8b-cpt-sea-lionv2-instruct-gguf

Updated Aug 3, 2024 • 9

QuantFactory/shieldgemma-2b-GGUF

Text Generation • Updated Aug 3, 2024 • 98 • 1

QuantFactory/shieldgemma-9b-GGUF

Text Generation • Updated Aug 3, 2024 • 24 • 2

mohan11111/SeaLLM-7B-v2-pytorch

Updated Aug 6, 2024 • 3

LiteLLMs/shieldgemma-2b-GGUF

Text Generation • Updated Aug 9, 2024 • 59

LiteLLMs/shieldgemma-9b-GGUF

Text Generation • Updated Aug 9, 2024 • 40

RichardErkhov/ghost-x_-_ghost-8b-beta-gguf

Updated Aug 13, 2024 • 192

RichardErkhov/wang7776_-_vicuna-7b-v1.3-sparsity-20-gguf

Updated Aug 18, 2024 • 24