File size: 343 Bytes
7449d16
 
 
 
 
 
 
 
 
 
ae2e095
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
---
license: gemma
language:
- en
pipeline_tag: text-generation
tags:
- google
- gemma
- gguf
- imatrix
---

# Google Gemma 9B IT GGUF

- just f32 gguf from official kaggle repo reuploaded for now
- imatrix quants are running
- you will need the gemma2 llama.cpp [PR](https://github.com/ggerganov/llama.cpp/pull/8156) applied to your llama.cpp