leliuga/Llama-2-7b-hf-bnb-4bit
Text Generation
•
Updated
•
6
bnb-4 bit
A 4-bit quantized version models designed for fine-tuning. Demo: https://colab.research.google.com/drive/19UpFUjtbJoLua-4DMb1JKKwJAcvMyMHb
-
-
leliuga/Llama-2-7b-chat-hf-bnb-4bit
Text Generation • Updated • 27 -
leliuga/Llama-2-13b-hf-bnb-4bit
Text Generation • Updated • 4 -
leliuga/Llama-2-13b-chat-hf-bnb-4bit
Text Generation • Updated • 73 -
leliuga/Meta-Llama-3-8B-bnb-4bit
Text Generation • Updated • 19 -
leliuga/Meta-Llama-3-8B-Instruct-bnb-4bit
Text Generation • Updated • 7 -
leliuga/Meta-Llama-Guard-2-8B-bnb-4bit
Text Generation • Updated • 12 • 1 -
leliuga/Mistral-7B-v0.1-bnb-4bit
Text Generation • Updated • 4 -
leliuga/mistral-7b-instruct-v0.1-bnb-4bit
Text Generation • Updated • 3 -
leliuga/mistral-7b-instruct-v0.2-bnb-4bit
Text Generation • Updated • 36 -
leliuga/phi-1-bnb-4bit
Text Generation • Updated • 5 -
leliuga/phi-2-bnb-4bit
Text Generation • Updated • 10 -
leliuga/Phi-3-mini-4k-instruct-bnb-4bit
Text Generation • Updated • 132 • 3 -
leliuga/Phi-3-mini-128k-instruct-bnb-4bit
Text Generation • Updated • 168 • 1 -
leliuga/gemma-2b-bnb-4bit
Text Generation • Updated • 18 -
leliuga/gemma-2b-it-bnb-4bit
Text Generation • Updated • 9 -
leliuga/gemma-7b-bnb-4bit
Text Generation • Updated • 5 -
leliuga/gemma-7b-it-bnb-4bit
Text Generation • Updated • 4 -
leliuga/gemma-2-9b-bnb-4bit
Text Generation • Updated • 82 -
leliuga/gemma-2-9b-it-bnb-4bit
Text Generation • Updated • 91