Quantization?

by PacmanIncarnate - opened 6 days ago

6 days ago

Any chance you could quantize the model? Could open it up to a lot more users.

3 days ago

Doctor-Shotgun/YuE-s1-7B-anneal-en-cot-exl2
Doctor-Shotgun/YuE-s2-1B-general-exl2

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment