Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs

Jinguo Zhu, Xizhou Zhu, Wenhai Wang, Xiaohua Wang, Hongsheng Li, Xiaogang Wang, Jifeng Dai. Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs. In Sanmi Koyejo, S. Mohamed, A. Agarwal, Danielle Belgrave, K. Cho, A. Oh, editors, Advances in Neural Information Processing Systems 35: Annual Conference on Neural Information Processing Systems 2022, NeurIPS 2022, New Orleans, LA, USA, November 28 - December 9, 2022. 2022. [doi]

Authors

Jinguo Zhu

This author has not been identified. Look up 'Jinguo Zhu' in Google

Xizhou Zhu

This author has not been identified. Look up 'Xizhou Zhu' in Google

Wenhai Wang

This author has not been identified. Look up 'Wenhai Wang' in Google

Xiaohua Wang

This author has not been identified. Look up 'Xiaohua Wang' in Google

Hongsheng Li

This author has not been identified. Look up 'Hongsheng Li' in Google

Xiaogang Wang

This author has not been identified. Look up 'Xiaogang Wang' in Google

Jifeng Dai

This author has not been identified. Look up 'Jifeng Dai' in Google