Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding

Sangmin Bae, Jongwoo Ko, Hwanjun Song, Se-Young Yun. Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023. pages 5910-5924, Association for Computational Linguistics, 2023. [doi]

@inproceedings{BaeKSY23,
  title = {Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding},
  author = {Sangmin Bae and Jongwoo Ko and Hwanjun Song and Se-Young Yun},
  year = {2023},
  url = {https://aclanthology.org/2023.emnlp-main.362},
  researchr = {https://researchr.org/publication/BaeKSY23},
  cites = {0},
  citedby = {0},
  pages = {5910-5924},
  booktitle = {Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023},
  editor = {Houda Bouamor and Juan Pino 0001 and Kalika Bali},
  publisher = {Association for Computational Linguistics},
  isbn = {979-8-89176-060-8},
}