Hugging Face's logo

Felladrin
/
gguf-sharded-Q4_K_S-OLMoE-1B-7B-0924-Instruct

GGUF
Inference Endpoints
imatrix
conversational
Model card Files Community

Sharded GGUF version of bartowski/OLMoE-1B-7B-0924-Instruct-GGUF.

Downloads last month
18
GGUF
Model size
6.92B params
Architecture
olmoe
View all files
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for Felladrin/gguf-sharded-Q4_K_S-OLMoE-1B-7B-0924-Instruct

Base model

allenai/OLMoE-1B-7B-0924
Finetuned
allenai/OLMoE-1B-7B-0924-SFT
Finetuned
allenai/OLMoE-1B-7B-0924-Instruct
Quantized
bartowski/OLMoE-1B-7B-0924-Instruct-GGUF
Quantized
(4)
this model