---
library_name: transformers
license: apache-2.0
datasets:
- Mozilla/smart_ner_dataset
language:
- en
base_model:
- distilbert/distilbert-base-uncased
pipeline_tag: token-classification
---

# Fine-tuned LoRA Token classification on distilbert

This is a fine-tuned LoRA token classifier on distilbert, designed for NER  on multiple categories PERSON, ORG, CITY, STATE, CITY_STATE.

## Model Details

### Model Description

This model is based on distilbert/distilbert-base-uncased and fine-tuned using LoRA for token classification. The fine-tuning process adapts the model to predict tokens across 10 categories:

    "O"  # Outside any named entity
    "B-PER"       # Beginning of a person entity
    "I-PER"       # Inside a person entity
    "B-ORG"       # Beginning of an organization entity
    "I-ORG"       # Inside an organization entity
    "B-CITY"      # Beginning of a city entity
    "I-CITY"      # Inside a city entity
    "B-STATE"     # Beginning of a state entity
    "I-STATE"     # Inside a state entity
    "B-CITYSTATE" # Beginning of a city_state entity
    "I-CITYSTATE" # Inside a city_state entity

---


- **Developed by:** Mozilla
- **Language(s):** English (`en`)
- **License:** Apache-2.0
- **Fine-tuned from:** [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased)

### Model Sources

- **Repository:** [Mozilla Smart Intent Project](https://github.com/mozilla/smart_intent)

### Citation

If you use this model, please cite it as:
```
@misc{mozilla_distilbert_lora_ner,
  title       = {Fine-tuned LoRA Token Classifier on DistilBERT},
  author      = {Mozilla},
  year        = {2024},
  url         = {https://huggingface.co/Mozilla/distilbert-finetuned-LoRA-token-classifier},
  license     = {Apache-2.0}
}
```