Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Blackroot
/
Differential-Microllama-2
like
1
llama
arxiv:
2410.05258
Model card
Files
Files and versions
Community
Train
dc8dae9
Differential-Microllama-2
/
llama_modeling
1 contributor
History:
1 commit
Blackroot
Upload 19 files
a83aa44
verified
15 days ago
__init__.py
Safe
0 Bytes
Upload 19 files
15 days ago
attention.py
Safe
4.41 kB
Upload 19 files
15 days ago
config.py
Safe
419 Bytes
Upload 19 files
15 days ago
decoder.py
Safe
1.5 kB
Upload 19 files
15 days ago
diff_attn.py
Safe
5.84 kB
Upload 19 files
15 days ago
extact.py
Safe
1.02 kB
Upload 19 files
15 days ago
front_end.py
Safe
3.12 kB
Upload 19 files
15 days ago
liger_rope.py
Safe
10.2 kB
Upload 19 files
15 days ago
mlp.py
Safe
719 Bytes
Upload 19 files
15 days ago
model.py
Safe
1.21 kB
Upload 19 files
15 days ago
rms_norm.py
Safe
614 Bytes
Upload 19 files
15 days ago
rope.py
Safe
1.44 kB
Upload 19 files
15 days ago
tensor_prod_attn.py
Safe
5.92 kB
Upload 19 files
15 days ago