Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training

Yuanxin Liu, Fandong Meng, Zheng Lin 0001, Peng Fu 0008, Yanan Cao, Weiping Wang 0005, Jie Zhou 0016. Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training. In Marine Carpuat, Marie-Catherine de Marneffe, Iván Vladimir Meza Ruíz, editors, Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10-15, 2022. pages 5840-5857, Association for Computational Linguistics, 2022. [doi]

Authors

Yuanxin Liu

This author has not been identified. Look up 'Yuanxin Liu' in Google

Fandong Meng

This author has not been identified. Look up 'Fandong Meng' in Google

Zheng Lin 0001

This author has not been identified. Look up 'Zheng Lin 0001' in Google

Peng Fu 0008

This author has not been identified. Look up 'Peng Fu 0008' in Google

Yanan Cao

This author has not been identified. Look up 'Yanan Cao' in Google

Weiping Wang 0005

This author has not been identified. Look up 'Weiping Wang 0005' in Google

Jie Zhou 0016

This author has not been identified. Look up 'Jie Zhou 0016' in Google