inflatebot's picture
Update README.md
00b7487 verified
metadata
base_model:
  - inflatebot/MN-12B-Mag-Mell-R1
base_model_relation: quantized

Official EXL2 quants for MN-12B-Mag-Mell-R1.

(We forgot 8.0. Sorry. If you need 8.0, let us know.)

Each bit weight is a branch. Click on the "main" button to see the branch names, and download them with

git lfs install && git clone -b <branch-name> https://huggingface.co/Alfitaria/MN-12B-Mag-Mell-R1-exl2/.