mav23
/

falcon-mamba-7b-instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

falcon-mamba-7b-instruct-GGUF

1 contributor

History: 14 commits

mav23's picture

Upload folder using huggingface_hub

4f442c8 verified 4 months ago

.gitattributes

2.45 kB

Upload folder using huggingface_hub 4 months ago
README.md

14.3 kB

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q2_K.gguf

2.57 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q3_K.gguf

3.28 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q3_K_L.gguf

3.28 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q3_K_M.gguf

3.28 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q3_K_S.gguf

3.28 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q4_0.gguf

4.2 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q4_1.gguf

4.64 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q4_K.gguf

4.2 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q4_K_M.gguf

4.2 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q4_K_S.gguf

4.2 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q5_0.gguf

5.08 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q5_1.gguf

5.52 GB
LFS

Upload folder using huggingface_hub 4 months ago
falcon-mamba-7b-instruct.Q5_K.gguf

5.08 GB
LFS

Upload folder using huggingface_hub 4 months ago