Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training

Yuanxin Liu, Fandong Meng, Zheng Lin 0001, Peng Fu 0008, Yanan Cao, Weiping Wang 0005, Jie Zhou 0016. Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training. In Marine Carpuat, Marie-Catherine de Marneffe, Iván Vladimir Meza Ruíz, editors, Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10-15, 2022. pages 5840-5857, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.