Rare Words: A Major Problem for Contextualized Embeddings and How to Fix it by Attentive Mimicking

Timo Schick, Hinrich Schütze. Rare Words: A Major Problem for Contextualized Embeddings and How to Fix it by Attentive Mimicking. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7-12, 2020. pages 8766-8774, AAAI Press, 2020. [doi]

Abstract

Abstract is missing.