DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

This is made by using llama-export-lora

Base model: https://huggingface.co/bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF
LoRA adapter: https://huggingface.co/ggml-org/LoRA-Qwen2.5-7B-Instruct-abliterated-v3-F16-GGUF

Downloads last month: 4,657

GGUF

Model size

7.62B params

Architecture

qwen2

4-bit

16-bit

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for ngxson/DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

Base model

deepseek-ai/DeepSeek-R1-Distill-Qwen-7B

Quantized

(85)

this model

ngxson
/

DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

Model tree for ngxson/DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF

Space using ngxson/DeepSeek-R1-Distill-Qwen-7B-abliterated-GGUF 1