getting error
Hey I just see this model and was very excited to try it, but getting below error
(Exit code: 18446744073709515000). Unknown error. Try a different model and/or config.
that's odd, can you confirm your LM Studio version and your hardware? Or if not in lmstudio, what you're running it in?
LM Studio 0.3.8 build 4
I even updated to 0.3.9 build 5 but same issue.
I have a 3060ti with 8GB of VRAM with 32GB RAM i7 machine, and I am trying to use smallest Q3KL version of model (approx 4GB in size).
Even on ollama getting this error
I got this error to.
The fact you're getting it on ollama as well is quite curious..
Can you double check the sha256sum?
@ryg81 What LM Runtime(CTRL+SHIFT+R) are you using? In LM Studio you need to be on llama.cpp ver v1.11.0
I see, the stable version off llama.cpp is ver v1.10.0, and the support for this model is added with v1.11.0, you have to select beta version and install the latest version.
OK, so switching to beta channel make it work.
