Quantization

#1
by shadow123 - opened

Can you make a GPTQ Int8 for it? Thx

Sign up or log in to comment