Note:

This repo hosts only a Q5_K_S iMatrix of Dark Sapling v2.0 7B. GGUF quant is from Lewdiculous/DarkSapling-7B-v2.0-GGUF-IQ-Imatrix. The additional files in this GGUF repo is for personal usage using Text Gen Webui with llamacpp_hf.

Downloads last month
27
GGUF
Model size
7.24B params
Architecture
llama

5-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.