Hugging Face's logo

waldie
/
airoboros-l2-13b-3.1.1-8bpw-h8-exl2

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community

quant of jondurbin's airoboros-l2-13b-3.1.1

python3 convert.py \
    -i /input/jondurbin_airoboros-l2-13b-3.1.1/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/8.0bpw/ \
    -b 8.0 \
    -hb 8
Downloads last month
7
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train waldie/airoboros-l2-13b-3.1.1-8bpw-h8-exl2