Text Generation
GGUF
English
Qwen2.5-Coder-1.5B
Inference Endpoints
conversational

Melvin56/Hammer2.1-1.5b-GGUF

Original Model : https://huggingface.co/MadeAgents/Hammer2.1-1.5b

All quants are made using the imatrix option.

Model Size (GB)
Q2_K_S 0.63
Q2_K 0.67
Q3_K_M 0.82
Q3_K_M 0.82
Q4_0 0.93
Q4_K_M 0.98
Q5_K_M 1.12
Q6_K 1.27
Q8_0 1.64
F16 3.08
Downloads last month
169
GGUF
Model size
1.54B params
Architecture
qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for Melvin56/Hammer2.1-1.5b-GGUF

Base model

Qwen/Qwen2.5-1.5B
Quantized
(4)
this model

Datasets used to train Melvin56/Hammer2.1-1.5b-GGUF