Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
compressa-ai
/
Llama-3-70B-Instruct-OmniQuant
like
0
Follow
Compressa
7
Text Generation
Transformers
Safetensors
llama
llama3
omniquant
gptq
triton
conversational
text-generation-inference
Inference Endpoints
4-bit precision
License:
llama3
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
a630053
Llama-3-70B-Instruct-OmniQuant
2 contributors
History:
4 commits
Vasily Alexeev
fix naming style in tables
a630053
10 months ago
.gitattributes
Safe
1.52 kB
initial commit
10 months ago
README.md
Safe
6.23 kB
fix naming style in tables
10 months ago
compressa-config.json
Safe
707 Bytes
add model
10 months ago
config.json
Safe
898 Bytes
add model
10 months ago
generation_config.json
Safe
131 Bytes
add model
10 months ago
model-00001-of-00009.safetensors
Safe
4.97 GB
LFS
add model
10 months ago
model-00002-of-00009.safetensors
Safe
4.89 GB
LFS
add model
10 months ago
model-00003-of-00009.safetensors
Safe
4.89 GB
LFS
add model
10 months ago
model-00004-of-00009.safetensors
Safe
4.89 GB
LFS
add model
10 months ago
model-00005-of-00009.safetensors
Safe
4.89 GB
LFS
add model
10 months ago
model-00006-of-00009.safetensors
Safe
4.89 GB
LFS
add model
10 months ago
model-00007-of-00009.safetensors
Safe
4.89 GB
LFS
add model
10 months ago
model-00008-of-00009.safetensors
Safe
3.36 GB
LFS
add model
10 months ago
model-00009-of-00009.safetensors
Safe
2.1 GB
LFS
add model
10 months ago
model.safetensors.index.json
Safe
196 kB
add model
10 months ago
quant_config.json
Safe
63 Bytes
add model
10 months ago
special_tokens_map.json
Safe
301 Bytes
add model
10 months ago
tokenizer.json
Safe
9.08 MB
add model
10 months ago
tokenizer_config.json
Safe
51.4 kB
add model
10 months ago