Hugging Face's logo

Yhyu13
/
manticore-13b-gptq-4bit

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community

GPTQ 4-bit no actor version for compatibility that works in textgen-webui

Generated by using scripts from https://gitee.com/yhyu13/llama_-tools

Original weights: https://huggingface.co/openaccess-ai-collective/manticore-13b

Manticore is by far the most satisfying LLaMA model I've used due to its fine-tuning datasets are generated from the best of Vicuna, Wizard, and ShareGPT/GPT4.

Here is a conversation generated in textgen-webui, it shows step by step Chain of Thoughts comments along side generating complex code sample in an engaging tone!

sample

Downloads last month
1,367
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.