Hugging Face's logo

solidrust
/
Mixtral-3x7B-Instruct-v0.1-AWQ

Text Generation
Transformers
Safetensors
mixtral
4-bit precision
AWQ
Inference Endpoints
conversational
text-generation-inference
awq
Model card Files Community

fxmeng/Mixtral-3x7B-Instruct-v0.1 AWQ

Model Summary

Author does not provide details

Downloads last month
5
Safetensors
Model size
2.7B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API has been turned off for this model.

Model tree for solidrust/Mixtral-3x7B-Instruct-v0.1-AWQ

Base model

fxmeng/Mixtral-3x7B-Instruct-v0.1
Quantized
(1)
this model

Collection including solidrust/Mixtral-3x7B-Instruct-v0.1-AWQ