Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model

Zirui Liu, Guanchu Wang, Shaochen (Henry) Zhong, Zhaozhuo Xu, Daochen Zha, Ruixiang (Ryan) Tang, Zhimeng Stephen Jiang, Kaixiong Zhou, Vipin Chaudhary, Shuai Xu, Xia Hu. Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

@inproceedings{LiuWZXZTJZCXH23,
  title = {Winner-Take-All Column Row Sampling for Memory Efficient Adaptation of Language Model},
  author = {Zirui Liu and Guanchu Wang and Shaochen (Henry) Zhong and Zhaozhuo Xu and Daochen Zha and Ruixiang (Ryan) Tang and Zhimeng Stephen Jiang and Kaixiong Zhou and Vipin Chaudhary and Shuai Xu and Xia Hu},
  year = {2023},
  url = {http://papers.nips.cc/paper_files/paper/2023/hash/0a6059857ae5c82ea9726ee9282a7145-Abstract-Conference.html},
  researchr = {https://researchr.org/publication/LiuWZXZTJZCXH23},
  cites = {0},
  citedby = {0},
  booktitle = {Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023},
  editor = {Alice Oh and Tristan Naumann and Amir Globerson and Kate Saenko and Moritz Hardt and Sergey Levine},
}