Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
eaddario
/
Watt-Tool-8B-GGUF
like
0
Text Generation
GGUF
eaddario/imatrix-calibration
English
quant
Inference Endpoints
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Deploy
Use this model
dd7f5b0
Watt-Tool-8B-GGUF
1 contributor
History:
27 commits
eaddario
Generate Q3_K_L quant
dd7f5b0
unverified
14 days ago
imatrix
Generate Large imatrix
14 days ago
logits
Generate base model logits
14 days ago
.gitattributes
Safe
1.65 kB
Update lfs attributes
14 days ago
.gitignore
Safe
6.78 kB
Update lfs attributes and ignores
14 days ago
watt-tool-8B-F16.gguf
Safe
16.1 GB
LFS
Convert to GGUF @ F16
14 days ago
watt-tool-8B-Q3_K_L.gguf
Safe
4.32 GB
LFS
Generate Q3_K_L quant
14 days ago
watt-tool-8B-Q3_K_M.gguf
Safe
4.02 GB
LFS
Generate Q3_K_M quant
14 days ago
watt-tool-8B-Q3_K_S.gguf
Safe
3.66 GB
LFS
Generate Q3_K_S quant
14 days ago
watt-tool-8B-Q4_K_M.gguf
Safe
4.92 GB
LFS
Generate Q4_K_M quant
14 days ago
watt-tool-8B-Q4_K_S.gguf
Safe
4.69 GB
LFS
Generate Q4_K_S quant
14 days ago
watt-tool-8B-Q5_K_M.gguf
Safe
5.73 GB
LFS
Generate Q5_K_M quant
14 days ago
watt-tool-8B-Q5_K_S.gguf
Safe
5.6 GB
LFS
Generate Q5_K_S quant
14 days ago
watt-tool-8B-Q6_K.gguf
Safe
6.6 GB
LFS
Generate Q6_K quant
14 days ago
watt-tool-8B-Q8_0.gguf
Safe
8.54 GB
LFS
Generate Q8_0 quant
14 days ago