Edit Models filters

Model Tree

ibm-granite/granite-3.1-8b-base

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

17

Full-text search

Active filters: ibm-granite/granite-3.1-8b-base

DevQuasar/ibm-granite.granite-3.1-8b-base-GGUF

Text Generation • Updated 5 days ago • 32 • 1

ticlazau/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 10

QuantFactory/granite-3.1-8b-instruct-GGUF

Text Generation • Updated Dec 19, 2024 • 730 • 7

mradermacher/granite-3.1-8b-base-GGUF

Updated Dec 20, 2024 • 21

mradermacher/granite-3.1-8b-base-i1-GGUF

Updated Dec 20, 2024 • 70

itlwas/granite-3.1-8b-base-Q4_K_M-GGUF

Updated Dec 23, 2024 • 7

tensorblock/granite-3.1-8b-base-GGUF

Updated Jan 1 • 67

Triangle104/granite-3.1-8b-base-Q4_K_S-GGUF

Updated 25 days ago • 26

Triangle104/granite-3.1-8b-base-Q4_K_M-GGUF

Updated 25 days ago • 22

Triangle104/granite-3.1-8b-base-Q5_K_S-GGUF

Updated 25 days ago • 36

Triangle104/granite-3.1-8b-base-Q5_K_M-GGUF

Updated 25 days ago • 27

Triangle104/granite-3.1-8b-base-Q6_K-GGUF

Updated 25 days ago • 33

Triangle104/granite-3.1-8b-base-Q8_0-GGUF

Updated 25 days ago • 92

neuralmagic/granite-3.1-8b-base-quantized.w8a8

Text Generation • Updated 7 days ago • 12

neuralmagic/granite-3.1-8b-base-quantized.w4a16

Text Generation • Updated 7 days ago • 33

async0x42/granite-3.1-8b-instruct-exl2_4.65bpw

Text Generation • Updated 13 days ago • 4

TheMelonGod/granite-3.1-8b-base-exl2

Text Generation • Updated 8 days ago • 74