FAN: Fourier Analysis Networks
Paper
•
2410.02675
•
Published
•
28
interesting architecture
-
-
Tensor Product Attention Is All You Need
Paper • 2501.06425 • Published • 88 -
Scalable-Softmax Is Superior for Attention
Paper • 2501.19399 • Published • 22 -
EQ-VAE: Equivariance Regularized Latent Space for Improved Generative Image Modeling
Paper • 2502.09509 • Published • 8 -
YOLOv12: Attention-Centric Real-Time Object Detectors
Paper • 2502.12524 • Published • 12 -
SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
Paper • 2502.14786 • Published • 151 -
Large Language Diffusion Models
Paper • 2502.09992 • Published • 122 -
ObjectMover: Generative Object Movement with Video Prior
Paper • 2503.08037 • Published • 5 -
Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models
Paper • 2503.09573 • Published • 73 -
Transformers without Normalization
Paper • 2503.10622 • Published • 169 -
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Paper • 2503.14456 • Published • 152 -
Scaling Vision Pre-Training to 4K Resolution
Paper • 2503.19903 • Published • 41 -
Multi-Token Attention
Paper • 2504.00927 • Published • 55 -
TransMamba: Flexibly Switching between Transformer and Mamba
Paper • 2503.24067 • Published • 21 -
Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
Paper • 2504.20966 • Published • 33 -
MMaDA: Multimodal Large Diffusion Language Models
Paper • 2505.15809 • Published • 96 -
MiniCPM4: Ultra-Efficient LLMs on End Devices
Paper • 2506.07900 • Published • 92 -
Radial Attention: O(nlog n) Sparse Attention with Energy Decay for Long Video Generation
Paper • 2506.19852 • Published • 41 -
Representing Speech Through Autoregressive Prediction of Cochlear Tokens
Paper • 2508.11598 • Published • 17 -
DINOv3
Paper • 2508.10104 • Published • 273 -
2D Gaussian Splatting with Semantic Alignment for Image Inpainting
Paper • 2509.01964 • Published • 6 -
Sequential Diffusion Language Models
Paper • 2509.24007 • Published • 41 -
BitNet Distillation
Paper • 2510.13998 • Published • 44 -
AnyUp: Universal Feature Upsampling
Paper • 2510.12764 • Published • 10 -
Latent Diffusion Model without Variational Autoencoder
Paper • 2510.15301 • Published • 34