Model Card for Mistral-7B-Instruct-NF4

Model Details

This model is a NF4 quantized version of the mistralai/Mistral-7B-Instruct-v0.2 model.

  • Developed by: Ted Whooley
  • Library: Transformers, NF4
  • Model type: mistral
  • Model name: Mistral-7B-Instruct-NF4
  • Pipeline tag: text-generation
  • Qunatized by: twhoool02
  • Language(s) (NLP): en
  • License: other
Downloads last month
77
Safetensors
Model size
3.86B params
Tensor type
F32
FP16
U8
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for twhoool02/Mistral-7B-Instruct-NF4

Quantized
(88)
this model