RoFormer: Enhanced transformer with Rotary Position Embedding

Jianlin Su, Murtadha H. M. Ahmed, Yu Lu, Shengfeng Pan, Wen Bo, Yunfeng Liu. RoFormer: Enhanced transformer with Rotary Position Embedding. Neurocomputing, 568:127063, February 2024. [doi]

Abstract

Abstract is missing.