ViTALiTy: Unifying Low-rank and Sparse Approximation for Vision Transformer Acceleration with a Linear Taylor Attention

Publication
In IEEE Symposium on High-Performance Computer Architecture
Shang Wu
Shang Wu
PhD Student @ NU

My research focuses on physically plausible video generation and world models.