bitnet-5B-v1

I redesigned mergekit so that I could merge the bitnet 3B model (unlike version v0, where I did merge via PyTorch).

In theory, this is compatible with quantization via llama.cpp , but tests are needed.

Downloads last month: 12

Safetensors

Model size

4.56B params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for Ttimofeyka/bitnet-5B-v1

Base model

1bitLLM/bitnet_b1_58-3B

Finetuned

(1)

this model