Sparse Modular Activation for Efficient Sequence Modeling

Liliang Ren, Yang Liu, Shuohang Wang, Yichong Xu, Chenguang Zhu, ChengXiang Zhai. Sparse Modular Activation for Efficient Sequence Modeling. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

Authors

Liliang Ren

This author has not been identified. Look up 'Liliang Ren' in Google

Yang Liu

This author has not been identified. Look up 'Yang Liu' in Google

Shuohang Wang

This author has not been identified. Look up 'Shuohang Wang' in Google

Yichong Xu

This author has not been identified. Look up 'Yichong Xu' in Google

Chenguang Zhu

This author has not been identified. Look up 'Chenguang Zhu' in Google

ChengXiang Zhai

This author has not been identified. Look up 'ChengXiang Zhai' in Google