On Scalar Embedding of Relative Positions in Attention Models

Junshuang Wu, Richong Zhang, Yongyi Mao, Junfan Chen. On Scalar Embedding of Relative Positions in Attention Models. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021. pages 14050-14057, AAAI Press, 2021. [doi]

Abstract

Abstract is missing.