Unknown quantization type
#120
by
Reewaz321
- opened
I was integrating Deepseek Ai in env Pyhton but I am getting this error.
Any leads?
Please
ValueError: Unknown quantization type, got fp8 - supported types are: ['awq', 'bitsandbytes_4bit', 'bitsandbytes_8bit', 'gptq', 'aqlm', 'quanto', 'eetq', 'higgs', 'hqq', 'compressed-tensors', 'fbgemm_fp8', 'torchao',
'bitnet', 'vptq']
yes , same with me
yes , same with me