Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging

Peng Lu, Ivan Kobyzev, Mehdi Rezagholizadeh, Ahmad Rashid, Ali Ghodsi 0001, Philippe Langlais. Improving Generalization of Pre-trained Language Models via Stochastic Weight Averaging. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Findings of the Association for Computational Linguistics: EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11, 2022. pages 4948-4954, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.