Probe-Less Probing of BERT's Layer-Wise Linguistic Knowledge with Masked Word Prediction

Tatsuya Aoyama, Nathan Schneider 0001. Probe-Less Probing of BERT's Layer-Wise Linguistic Knowledge with Masked Word Prediction. In Daphne Ippolito, Liunian Harold Li, Maria Leonor Pacheco, Danqi Chen, Nianwen Xue, editors, Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Student Research Workshop, NAACL-HLT 2022, Hybrid Event / Seattle, WA, USA, July 10-15, 2022. pages 195-201, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.