AlbertShi's picture

4 13

AlbertShi

AlbertShi

·

AI & ML interests

None yet

Recent Activity

upvoted a paper 4 days ago

Trainable Dynamic Mask Sparse Attention

reacted to JingzeShi's post with 🤗 4 days ago

Trainable selective sampling and sparse attention kernels are indispensable in the era of context engineering. We hope our work will be helpful to everyone! 🤗 https://huggingface.co/papers/2508.02124

liked a dataset 4 months ago

SmallDoge/SmallTalks

View all activity

Organizations

upvoted a paper 4 days ago

Trainable Dynamic Mask Sparse Attention

Paper • 2508.02124 • Published 5 days ago • 12

upvoted a collection 4 months ago

🐕Small-Doges

Doge family of small language models! • 18 items • Updated Apr 21 • 8

upvoted a paper 6 months ago

Wonderful Matrices: Combining for a More Efficient and Effective Foundation Model Architecture

Paper • 2412.11834 • Published Dec 16, 2024 • 8

upvoted a collection 6 months ago

Doge

Doge family of small language models. • 12 items • Updated Mar 28 • 6