State Space Models

state-spaces's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

tridao 

authored a paper 3 months ago

RedPajama: an Open Dataset for Training Large Language Models

Paper • 2411.12372 • Published Nov 19, 2024 • 51

ArthurZ 

posted an update 3 months ago

view post

Post

3139

Native tensor parallel has landed in transformers!!! https://github.com/huggingface/transformers/pull/34184 thanks a lot to the torch team for their support!

Contributions are welcome to support more models! 🔥

🔥

13

13

❤️

5

5

🤯

3

3

🤝

3

3

+

Reply

tridao 

authored a paper 5 months ago

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

Paper • 2408.15237 • Published Aug 27, 2024 • 39

mamba-checkpoints 

authored a paper 7 months ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31, 2024 • 64

albertgu 

authored a paper 8 months ago

Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality

Paper • 2405.21060 • Published May 31, 2024 • 64

mamba-checkpoints 

updated a model 9 months ago

state-spaces/mamba-2.8b

Updated May 11, 2024 • 12.6k • 146

ArthurZ 

authored a paper 10 months ago

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published Apr 11, 2024 • 44

albertgu 

authored a paper 11 months ago

Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling

Paper • 2403.03234 • Published Mar 5, 2024 • 13

tridao 

authored a paper 11 months ago

Caduceus: Bi-Directional Equivariant Long-Range DNA Sequence Modeling

Paper • 2403.03234 • Published Mar 5, 2024 • 13

ArthurZ 

posted an update 11 months ago

view post

Post

mamba is now available in transformers. Thanks to @tridao and @albertgu for this brilliant model! 🚀 and the amazing mamba-ssm kernels powering this!
Checkout the collection here:
state-spaces/transformers-compatible-mamba-65e7b40ab87e5297e45ae406

• 
• 
• 
• 5 replies

·

🤝

10

10

❤️

7

7

+

Reply

ArthurZ 

updated 6 models 11 months ago

state-spaces/mamba-2.8b-hf

Text Generation • Updated Mar 6, 2024 • 5.52k • 98

state-spaces/mamba-1.4b-hf

Text Generation • Updated Mar 6, 2024 • 4.35k • 10

state-spaces/mamba-790m-hf

Text Generation • Updated Mar 6, 2024 • 1.57k • 3

state-spaces/mamba-370m-hf

Text Generation • Updated Mar 6, 2024 • 2.93k • 13

state-spaces/mamba-130m-hf

Text Generation • Updated Mar 6, 2024 • 47.2k • 52

state-spaces/mamba-390m-hf

Updated Mar 6, 2024

tridao 

authored a paper 11 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 137

ArthurZ 

authored a paper 11 months ago

StarCoder 2 and The Stack v2: The Next Generation

Paper • 2402.19173 • Published Feb 29, 2024 • 137

albertgu 

authored a paper 11 months ago

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Paper • 2402.19427 • Published Feb 29, 2024 • 53

ArthurZ 

posted an update 12 months ago

view post

Post

Just when I was about to go to bed....... Here we go again

• 

👍

17

17

🤯

8

8

🤗

4

4

+

Reply