Read-ME: Refactorizing LLMs as Router-Decoupled Mixture of Experts with System Co-Design
Paper
•
2410.19123
•
Published
•
15
•
2
Ruisi Cai
CCCCRS
·
AI & ML interests
None yet
Recent Activity
authored
a paper
about 1 month ago
Rethinking Addressing in Language Models via Contexualized Equivariant
Positional Encoding
upvoted
a
paper
about 1 month ago
Understanding and Mitigating Bottlenecks of State Space Models through
the Lens of Recency and Over-smoothing
authored
a paper
3 months ago
Robust Weight Signatures: Gaining Robustness as Easy as Patching
Weights?
Organizations
CCCCRS's activity
commented
a
paper
3 months ago