Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
neuralmagic
/
granite-3.1-8b-base-quantized.w8a8
like
0
Follow
Neural Magic
307
Text Generation
Transformers
Safetensors
English
granite
w8a8
int8
vllm
Inference Endpoints
8-bit precision
compressed-tensors
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
main
granite-3.1-8b-base-quantized.w8a8
2 contributors
History:
9 commits
nm-research
Update README.md
aac8ed8
verified
7 days ago
.gitattributes
Safe
1.52 kB
initial commit
21 days ago
README.md
Safe
14.7 kB
Update README.md
7 days ago
config.json
Safe
1.91 kB
Upload model files
21 days ago
generation_config.json
Safe
132 Bytes
Upload model files
21 days ago
merges.txt
Safe
442 kB
Upload model files
21 days ago
model-00001-of-00002.safetensors
Safe
4.99 GB
LFS
Upload model files
21 days ago
model-00002-of-00002.safetensors
Safe
3.79 GB
LFS
Upload model files
21 days ago
model.safetensors.index.json
Safe
54.3 kB
Upload model files
21 days ago
recipe.yaml
Safe
723 Bytes
Upload model files
21 days ago
special_tokens_map.json
Safe
1.02 kB
Upload model files
21 days ago
tokenizer.json
Safe
3.48 MB
Upload model files
21 days ago
tokenizer_config.json
Safe
4.16 kB
Upload model files
21 days ago
vocab.json
Safe
777 kB
Upload model files
21 days ago