Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis

Ta-Chung Chi, Ting-Han Fan, Alexander Rudnicky, Peter J. Ramadge. Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis. In Anna Rogers, Jordan L. Boyd-Graber, Naoaki Okazaki, editors, Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023. pages 13522-13537, Association for Computational Linguistics, 2023. [doi]

@inproceedings{ChiFRR23,
  title = {Dissecting Transformer Length Extrapolation via the Lens of Receptive Field Analysis},
  author = {Ta-Chung Chi and Ting-Han Fan and Alexander Rudnicky and Peter J. Ramadge},
  year = {2023},
  url = {https://aclanthology.org/2023.acl-long.756},
  researchr = {https://researchr.org/publication/ChiFRR23},
  cites = {0},
  citedby = {0},
  pages = {13522-13537},
  booktitle = {Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2023, Toronto, Canada, July 9-14, 2023},
  editor = {Anna Rogers and Jordan L. Boyd-Graber and Naoaki Okazaki},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-959429-72-2},
}