ViTALiTy: Unifying Low-rank and Sparse Approximation for Vision Transformer Acceleration with a Linear Taylor Attention

Jyotikrishna Dass, Shang Wu, Huihong Shi, Chaojian Li, Zhifan Ye, Zhongfeng Wang, Yingyan Lin. ViTALiTy: Unifying Low-rank and Sparse Approximation for Vision Transformer Acceleration with a Linear Taylor Attention. In IEEE International Symposium on High-Performance Computer Architecture, HPCA 2023, Montreal, QC, Canada, February 25 - March 1, 2023. pages 415-428, IEEE, 2023. [doi]

Authors

Jyotikrishna Dass

This author has not been identified. Look up 'Jyotikrishna Dass' in Google

Shang Wu

This author has not been identified. Look up 'Shang Wu' in Google

Huihong Shi

This author has not been identified. Look up 'Huihong Shi' in Google

Chaojian Li

This author has not been identified. Look up 'Chaojian Li' in Google

Zhifan Ye

This author has not been identified. Look up 'Zhifan Ye' in Google

Zhongfeng Wang

This author has not been identified. Look up 'Zhongfeng Wang' in Google

Yingyan Lin

This author has not been identified. Look up 'Yingyan Lin' in Google