Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model

Zirui Liu, Guanchu Wang, Shaochen (Henry) Zhong, Zhaozhuo Xu, Daochen Zha, Ruixiang (Ryan) Tang, Zhimeng Stephen Jiang, Kaixiong Zhou, Vipin Chaudhary, Shuai Xu, Xia Hu. Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

Authors

Zirui Liu

This author has not been identified. Look up 'Zirui Liu' in Google

Guanchu Wang

This author has not been identified. Look up 'Guanchu Wang' in Google

Shaochen (Henry) Zhong

This author has not been identified. Look up 'Shaochen (Henry) Zhong' in Google

Zhaozhuo Xu

This author has not been identified. Look up 'Zhaozhuo Xu' in Google

Daochen Zha

This author has not been identified. Look up 'Daochen Zha' in Google

Ruixiang (Ryan) Tang

This author has not been identified. Look up 'Ruixiang (Ryan) Tang' in Google

Zhimeng Stephen Jiang

This author has not been identified. Look up 'Zhimeng Stephen Jiang' in Google

Kaixiong Zhou

This author has not been identified. Look up 'Kaixiong Zhou' in Google

Vipin Chaudhary

This author has not been identified. Look up 'Vipin Chaudhary' in Google

Shuai Xu

This author has not been identified. Look up 'Shuai Xu' in Google

Xia Hu

This author has not been identified. Look up 'Xia Hu' in Google