Circuit Complexity Bounds for RoPE-based Transformer Architecture

Bo Chen 0029, Xiaoyu Li, Yingyu Liang, Jiangxuan Long 0001, Zhenmei Shi, Zhao Song 0002, Jiahao Zhang. Circuit Complexity Bounds for RoPE-based Transformer Architecture. In Christos Christodoulopoulos 0001, Tanmoy Chakraborty 0002, Carolyn Rose, Violet Peng, editors, Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, EMNLP 2025, Suzhou, China, November 4-9, 2025. pages 11080-11097, Association for Computational Linguistics, 2025. [doi]

Abstract

Abstract is missing.