5 43 83

Yu Zhang

yzhangcs

https://yzhang.site

AI & ML interests

None yet

Recent Activity

updated a model about 11 hours ago

fla-hub/rwkv7-2.9B-world

updated a collection about 11 hours ago

RWKV7

published a model about 11 hours ago

fla-hub/rwkv7-2.9B-world

View all activity

Organizations

yzhangcs's activity

upvoted a paper 15 days ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Paper • 2411.04905 • Published Nov 7, 2024 • 115

upvoted a paper 20 days ago

Test-Time Preference Optimization: On-the-Fly Alignment via Iterative Textual Feedback

Paper • 2501.12895 • Published 20 days ago • 55

upvoted a collection 25 days ago

YuLan-Mini

Collection

A highly capable 2.4B lightweight LLM using only 1T pre-training data with all details. • 6 items • Updated 7 days ago • 13

upvoted a paper 28 days ago

Tensor Product Attention Is All You Need

Paper • 2501.06425 • Published Jan 11 • 83

upvoted an article about 2 months ago

Article

Saving Memory Using Padding-Free Transformer Layers during Finetuning

•

Jun 11, 2024

• 16

upvoted a collection about 2 months ago

OLMo 2

Collection

Artifacts for the second set of OLMo models. • 22 items • Updated about 20 hours ago • 82

upvoted a paper about 2 months ago

Multimodal Latent Language Modeling with Next-Token Diffusion

Paper • 2412.08635 • Published Dec 11, 2024 • 44

upvoted a paper 2 months ago

Gated Delta Networks: Improving Mamba2 with Delta Rule

Paper • 2412.06464 • Published Dec 9, 2024 • 10

upvoted 3 papers 3 months ago

upvoted a paper 5 months ago

Gated Linear Attention Transformers with Hardware-Efficient Training

Paper • 2312.06635 • Published Dec 11, 2023 • 6

upvoted a collection 5 months ago

GSA

Collection

3 items • Updated 11 days ago • 2

upvoted a paper 5 months ago

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Paper • 2409.07146 • Published Sep 11, 2024 • 20

upvoted a paper 6 months ago

Power Scheduler: A Batch Size and Token Number Agnostic Learning Rate Scheduler

Paper • 2408.13359 • Published Aug 23, 2024 • 24

upvoted 2 articles 6 months ago

Article

Cosmopedia: how to create large-scale synthetic data for pre-training Large Language Models

Mar 20, 2024

• 75

Article

SmolLM - blazingly fast and remarkably powerful

Jul 16, 2024

• 312

upvoted a paper 6 months ago

Fast Matrix Multiplications for Lookup Table-Quantized LLMs

Paper • 2407.10960 • Published Jul 15, 2024 • 12

upvoted 2 papers 8 months ago

Parallelizing Linear Transformers with the Delta Rule over Sequence Length

Paper • 2406.06484 • Published Jun 10, 2024 • 3

Scalable MatMul-free Language Modeling

Paper • 2406.02528 • Published Jun 4, 2024 • 11