---
base_model:
- allura-org/MoE-Girl-1BA-7BT
base_model_relation: quantized
---

GGUFs for [MoE-Girl.](https://huggingface.co/allura-org/MoE-Girl-1BA-7BT)

~~**Note: Until KoboldCPP merges the latest llama.cpp version, these won't work with it.** Use vLLM instead until then, see their page on [GGUF](https://docs.vllm.ai/en/latest/quantization/gguf.html)~~

These now work with KoboldCPP 1.76!