QuantFactory/Gemma-2-2b-Chinese-it-GGUF

This is quantized version of stvlynn/Gemma-2-2b-Chinese-it created using llama.cpp

Original Model Card

Gemma-2-2b-Chinese-it used approximately 6.4k rows of ruozhiba dataset to fine-tune Gemma-2-2b-it.

Gemma-2-2b-中文使用了约6.4k弱智吧数据对Gemma-2-2b-it进行微调

see Google's doc:

If you have any questions or suggestions, feel free to contact me.

GGUF

Model size

2.61B params

Architecture

gemma2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model is not currently available via any of the supported Inference Providers.

The model cannot be deployed to the HF Inference API: The model has no library tag.

Base model

Finetuned

Quantized

(147)

this model