Layer-wise Guided Training for BERT: Learning Incrementally Refined Document Representations

Nikolaos Manginas, Ilias Chalkidis, Prodromos Malakasiotis. Layer-wise Guided Training for BERT: Learning Incrementally Refined Document Representations. In Priyanka Agrawal, Zornitsa Kozareva, Julia Kreutzer, Gerasimos Lampouras, André F. T. Martins, Sujith Ravi, Andreas Vlachos 0001, editors, Proceedings of the Fourth Workshop on Structured Prediction for NLP@EMNLP 2020, Online, November 20, 2020. pages 53-61, Association for Computational Linguistics, 2020. [doi]

Abstract

Abstract is missing.