DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions

Haochen Wang, Junsong Fan, Yuxi Wang, Kaiyou Song, Tong Wang, Zhao-Xiang Zhang. DropPos: Pre-Training Vision Transformers by Reconstructing Dropped Positions. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

Authors

Haochen Wang

This author has not been identified. Look up 'Haochen Wang' in Google

Junsong Fan

This author has not been identified. Look up 'Junsong Fan' in Google

Yuxi Wang

This author has not been identified. Look up 'Yuxi Wang' in Google

Kaiyou Song

This author has not been identified. Look up 'Kaiyou Song' in Google

Tong Wang

This author has not been identified. Look up 'Tong Wang' in Google

Zhao-Xiang Zhang

This author has not been identified. Look up 'Zhao-Xiang Zhang' in Google