Please imatrix quant these models!
#560
by
sm54
- opened
Both are queued, and you can watch their progress at http://hf.tst.eu/status.html
Cheers!
mradermacher
changed discussion status to
closed
I think something went wrong:
-2000 30 si DeepSeek-R1-Distill-Qwen-14B error/1 bpe-pt missing (b3f499bb…)
You are correct - it's not supported by llama.cpp, unfortunately.
@mradermacher Please build latest llama.cpp and try again. Support for thouse model was merged 9 hours ago in https://github.com/ggerganov/llama.cpp/pull/11310
While we are at it let's also do all of them:
That was quick. They also released another 689B model (DeepSeek-R1-Zero). I'll download it on nico1.