Kijai

/

Mochi_preview_comfy

like 93

Hello,

Could you tell us how you managed to make a .safetensors format out of ggufs? I'm really interested of doing this because it could be used on hunyuan's model, I'd like to convert city's Q8_0.gguf of hunyuan into a Q8_0.safetensors so that the 3090 cards could use torch.compile (it was possible to do that on Q8_0's mochi). So far, if you go for fp8 Hunyuan, only the 40XX cards can do torch compile.
https://huggingface.co/city96/HunyuanVideo-gguf/tree/main