Hugging Face's logo

KoboldAI
/
Mixtral-8x7B-Holodeck-v1-GGUF

Text Generation
GGUF
PyTorch
English
mixtral
fine-tuned
Mixture of Experts
Inference Endpoints
Model card Files Community

Mixtral 8x7B - Holodeck

This is the GGUF version of the model meant for use with Koboldcpp

Model Description

Mistral 7B-Holodeck is a finetune created using Mixtral's 8x7B model.

Training data

The training data contains around 3000 ebooks in various genres. Most parts of the dataset have been prepended using the following text: [Genre: <genre1>, <genre2>]

Limitations and Biases

Based on known problems with NLP technology, potential relevant factors include bias (gender, profession, race and religion).

Downloads last month
428
GGUF
Model size
46.7B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.