Do Long-Range Language Models Actually Use Long-Range Context?

Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, Mohit Iyyer. Do Long-Range Language Models Actually Use Long-Range Context?. In Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih, editors, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. pages 807-822, Association for Computational Linguistics, 2021. [doi]

Authors

Simeng Sun

This author has not been identified. Look up 'Simeng Sun' in Google

Kalpesh Krishna

This author has not been identified. Look up 'Kalpesh Krishna' in Google

Andrew Mattarella-Micke

This author has not been identified. Look up 'Andrew Mattarella-Micke' in Google

Mohit Iyyer

This author has not been identified. Look up 'Mohit Iyyer' in Google