Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis

Ta-Chung Chi, Ting-Han Fan, Alexander Rudnicky, Peter J. Ramadge. Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis. In Anna Rogers, Jordan L. Boyd-Graber, Naoaki Okazaki, editors, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023. pages 13522-13537, Association for Computational Linguistics, 2023. [doi]

Authors

Ta-Chung Chi

This author has not been identified. Look up 'Ta-Chung Chi' in Google

Ting-Han Fan

This author has not been identified. Look up 'Ting-Han Fan' in Google

Alexander Rudnicky

This author has not been identified. Look up 'Alexander Rudnicky' in Google

Peter J. Ramadge

This author has not been identified. Look up 'Peter J. Ramadge' in Google