Shortformer: Better Language Modeling using Shorter Inputs

Ofir Press, Noah A. Smith, Mike Lewis. Shortformer: Better Language Modeling using Shorter Inputs. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021. pages 5493-5505, Association for Computational Linguistics, 2021. [doi]

@inproceedings{PressSL20a,
  title = {Shortformer: Better Language Modeling using Shorter Inputs},
  author = {Ofir Press and Noah A. Smith and Mike Lewis},
  year = {2021},
  url = {https://aclanthology.org/2021.acl-long.427},
  researchr = {https://researchr.org/publication/PressSL20a},
  cites = {0},
  citedby = {0},
  pages = {5493-5505},
  booktitle = {Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1-6, 2021},
  editor = {Chengqing Zong and Fei Xia and Wenjie Li 0002 and Roberto Navigli},
  publisher = {Association for Computational Linguistics},
  isbn = {978-1-954085-52-7},
}