PersonalAILabs
/

Llama-3.1-Quantized-4bit

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-Quantized-4bit

1 contributor

History: 3 commits

armstrongsam25's picture

Upload Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf

378433f verified 3 months ago

.gitattributes

1.67 kB

Upload Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf 3 months ago
Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf

37.9 GB
LFS

Upload Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf 3 months ago
Meta-Llama-3.1-8B-Instruct.IQ4_XS.gguf

4.48 GB
LFS

Upload Meta-Llama-3.1-8B-Instruct.IQ4_XS.gguf 3 months ago
README.md

29 Bytes

initial commit 3 months ago