These quantized models have a smaller memory footprint, but acceptable quality.
Crataco
Crataco
AI & ML interests
Using my best computers to quantize LLMs for your worst computers
Recent Activity
liked
a model
about 1 month ago
cognitivecomputations/Dolphin3.0-Llama3.2-1B
liked
a model
about 1 month ago
cognitivecomputations/Dolphin3.0-Qwen2.5-1.5B
updated
a collection
2 months ago
Favorite Low-End Models
Organizations
None yet
models
18
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/Nous-Hermes-2-Mistral-7B-DPO-imatrix-GGUF
Updated
•
602
•
5
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/phi-2-orange-v2-imatrix-GGUF
Updated
•
246
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/stablelm-2-1_6b-chat-imatrix-GGUF
Updated
•
847
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/cream-phi-2-v0.2-imatrix-GGUF
Updated
•
51
•
1
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/distilgpt2-82M-GGUF
Updated
•
307
•
3
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/TinyDolphin-2.8-1.1b-imatrix-GGUF
Updated
•
206
•
6
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/TinyDolphin-2.8.2-1.1B-laser-GGUF
Updated
•
163
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/Metharme-1.3B-GGML
Text Generation
•
Updated
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/RWKV-4-PilePlus-Series-GGML
Text Generation
•
Updated
•
3
![](https://cdn-avatars.huggingface.co/v1/production/uploads/6251b9851842c08ef3111c4f/dC-wuyxDxDWv7GQqNF25E.jpeg)
Crataco/GPT-2-Series-GGML
Text Generation
•
Updated
•
3
datasets
None public yet