Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers

Atsushi Shimizu, Shohei Taniguchi, Yutaka Matsuo. Position Encoding with Random Float Sampling Enhances Length Generalization of Transformers. In Vera Demberg, Kentaro Inui, LluĂ­s Marquez, editors, Findings of the Association for Computational Linguistics: EACL 2026, Rabat, Morocco, March 24-29, 2026. pages 4966-4980, Association for Computational Linguistics, 2026. [doi]

Abstract

Abstract is missing.