On Scalar Embedding of Relative Positions in Attention Models

Junshuang Wu, Richong Zhang, Yongyi Mao, Junfan Chen. On Scalar Embedding of Relative Positions in Attention Models. In Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021. pages 14050-14057, AAAI Press, 2021. [doi]

@inproceedings{WuZMC21-0,
  title = {On Scalar Embedding of Relative Positions in Attention Models},
  author = {Junshuang Wu and Richong Zhang and Yongyi Mao and Junfan Chen},
  year = {2021},
  url = {https://ojs.aaai.org/index.php/AAAI/article/view/17654},
  researchr = {https://researchr.org/publication/WuZMC21-0},
  cites = {0},
  citedby = {0},
  pages = {14050-14057},
  booktitle = {Thirty-Fifth AAAI Conference on Artificial Intelligence, AAAI 2021, Thirty-Third Conference on Innovative Applications of Artificial Intelligence, IAAI 2021, The Eleventh Symposium on Educational Advances in Artificial Intelligence, EAAI 2021, Virtual Event, February 2-9, 2021},
  publisher = {AAAI Press},
  isbn = {978-1-57735-866-4},
}