Twins: Revisiting the Design of Spatial Attention in Vision Transformers

Xiangxiang Chu, Zhi Tian, Yuqing Wang, Bo Zhang 0046, Haibing Ren, Xiaolin Wei, Huaxia Xia, Chunhua Shen. Twins: Revisiting the Design of Spatial Attention in Vision Transformers. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 9355-9366, 2021. [doi]

Authors

Xiangxiang Chu

This author has not been identified. Look up 'Xiangxiang Chu' in Google

Zhi Tian

This author has not been identified. Look up 'Zhi Tian' in Google

Yuqing Wang

This author has not been identified. Look up 'Yuqing Wang' in Google

Bo Zhang 0046

This author has not been identified. Look up 'Bo Zhang 0046' in Google

Haibing Ren

This author has not been identified. Look up 'Haibing Ren' in Google

Xiaolin Wei

This author has not been identified. Look up 'Xiaolin Wei' in Google

Huaxia Xia

This author has not been identified. Look up 'Huaxia Xia' in Google

Chunhua Shen

This author has not been identified. Look up 'Chunhua Shen' in Google