Cosine Attention (Cottention)
Collection
Models for the paper Cottention: Linear Transformers With Cosine Attention https://arxiv.org/abs/2409.18747
•
6 items
•
Updated
This repository contains the GPT-Soft-300m model described in Cottention: Linear Transformers With Cosine Attention.
- Downloads last month
- 2
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API was unable to determine this model's library.