ReAttention: Training-Free Infinite Context with Finite Attention Scope

Xiaoran Liu, Ruixiao Li, Zhigeng Liu, Qipeng Guo, Yuerong Song, Kai Lv 0001, Hang Yan 0001, Linlin Li 0001, Qun Liu 0001, Xipeng Qiu. ReAttention: Training-Free Infinite Context with Finite Attention Scope. In The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net, 2025. [doi]

Abstract

Abstract is missing.