GPTQ 4-bit no actor version for compatibility that works in textgen-webui

Generated by using scripts from https://gitee.com/yhyu13/llama_-tools

Original weight : https://huggingface.co/VMware/open-llama-7b-open-instruct

Downloads last month
11
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.