Hugging Face's logo

gstaff
/
TensorRT-LLM-engine-Mistral-7B-instruct-v0.2

Transformers
Inference Endpoints
Model card Files Community
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

TensorRT-LLM Engine Files for Mistral-7B-instruct-v0.2

This repo contains TensorRT-LLM engine files for Mistral-7B-instruct-v0.2 compiled on Windows 11 in single-GPU mode on a RTX 3080Ti GPU.

Downloads last month
10
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.