Hugging Face's logo

waldie
/
Mistral-Pygmalion-7b-4bpw-h6-exl2

Text Generation
Transformers
Safetensors
English
llama
Mistral
Pygmalion
llama-2
llama-2-7b
text-generation-inference
Inference Endpoints
Model card Files Community

quant of Delcos' MistralPy-7b

python3 convert.py \
    -i /input/Delcos_Mistral-Pygmalion-7b/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/4bpw/ \
    -b 4.0 \
    -hb 6
Downloads last month
11
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.