SHAPE : Shifted Absolute Position Embedding for Transformers

Shun Kiyono, Sosuke Kobayashi, Jun Suzuki, Kentaro Inui. SHAPE : Shifted Absolute Position Embedding for Transformers. In Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih, editors, Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 7-11 November, 2021. pages 3309-3321, Association for Computational Linguistics, 2021. [doi]

Authors

Shun Kiyono

This author has not been identified. Look up 'Shun Kiyono' in Google

Sosuke Kobayashi

This author has not been identified. Look up 'Sosuke Kobayashi' in Google

Jun Suzuki

This author has not been identified. Look up 'Jun Suzuki' in Google

Kentaro Inui

This author has not been identified. Look up 'Kentaro Inui' in Google