This is the 8-bit quantized version of meta-llama/Llama-Guard-3-8B by following the example from the AutoGPTQ repository.

Safety Codes:

Code Meaning
S1 Violent Crimes
S2 Non-Violent Crimes
S3 Sex-Related Crimes
S4 Child Sexual Exploitation
S5 Defamation
S6 Specialized Advice
S7 Privacy
S8 Intellectual Property
S9 Indiscriminate Weapons
S10 Hate
S11 Suicide & Self-Harm
S12 Sexual Content
S13 Elections
S14 Code Interpreter Abuse

license: llama3.1

Downloads last month
6
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for ktoprakucar/Llama-Guard-3-8B-Q8-GPTQ

Quantized
(13)
this model