Hugging Face's logo

theNovaAI
/
Hypernova-2x12B-exp-GGUF

Transformers
GGUF
Inference Endpoints
conversational
Model card Files Community

Hypernova-2x12B-exp

First time working with Mixture of Experts models

I have not had the time to try this model yet, but it took too much time and resources to not upload it

I am planning on improving this model in the future, so feedback on this model is welcomed

This model is mainly focused on RP and may produce NSFW content

It is a 2x12B model that loads like a 12B but uses both experts somehow

Get the transformers here: theNovaAI/Hypernova-2x12B-exp

Downloads last month
227
GGUF
Model size
21.1B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Model tree for theNovaAI/Hypernova-2x12B-exp-GGUF

Base model

mistralai/Mistral-Nemo-Base-2407
Finetuned
mistralai/Mistral-Nemo-Instruct-2407
Finetuned
theNovaAI/Hypernova-2x12B-exp
Quantized
(2)
this model

Collection including theNovaAI/Hypernova-2x12B-exp-GGUF