YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
Falcon-7B-Instruct 8-bit Model
This repository is home to the Falcon-7B-Instruct model, which has been carefully converted from its original 32-bit mode to an efficient and compact 8-bit mode.
Usage
You can use this model directly with a pipeline for tasks such as text generation and instruction following:
from transformers import pipeline
generator = pipeline('text-generation', model='tensorcat/falcon-7b-instruct-8bit')
print(generator("Generate a story about a spaceship traveling through space.", max_length=200))
- Downloads last month
- 113
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The HF Inference API does not support model that require custom code execution.