Unknown quantization type

#120
by Reewaz321 - opened

I was integrating Deepseek Ai in env Pyhton but I am getting this error.
Any leads?
Please

ValueError: Unknown quantization type, got fp8 - supported types are: ['awq', 'bitsandbytes_4bit', 'bitsandbytes_8bit', 'gptq', 'aqlm', 'quanto', 'eetq', 'higgs', 'hqq', 'compressed-tensors', 'fbgemm_fp8', 'torchao',
'bitnet', 'vptq']

yes , same with me

yes , same with me

Sign up or log in to comment