Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping

Chenghao Yang, Xuezhe Ma. Improving Stability of Fine-Tuning Pretrained Language Models via Component-Wise Gradient Norm Clipping. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11. pages 4854-4859, Association for Computational Linguistics, 2022. [doi]

References

No references recorded for this publication.

Cited by

No citations of this publication recorded.