DeepSeek-R1-Distill Quantized - a neuralmagic-ent Collection

neuralmagic-ent 's Collections

DeepSeek-R1-Distill Quantized

DeepSeek-Coder-V2-Instruct-0724 Quantized

DeepSeek-V2.5-1210 Quantized

Granite-3.1 Quantized

Mixtral 8x22B v0.1 Quantized

Mixtral 8x7B v0.1 Quantized

Llama 3.1 Nemotron Quantized

DeepSeekCoder-V2 Quantized

Qwen2.5 Math Quantized

Qwen2.5 Coder Quantized

Phi-3 Quantized

Llama 3.3 Quantized

Llama 3.2 Quantized

Llama 3.1 Quantized

DeepSeek-R1-Distill Quantized

updated 1 day ago

neuralmagic-ent/DeepSeek-R1-Distill-Qwen-14B-FP8-dynamic

Text Generation • Updated about 9 hours ago • 8
neuralmagic-ent/DeepSeek-R1-Distill-Qwen-32B-FP8-dynamic

Text Generation • Updated about 9 hours ago • 20