Compressing Context to Enhance Inference Efficiency of Large Language Models

Yucheng Li 0001, Bo Dong, Frank Guerin, Chenghua Lin. Compressing Context to Enhance Inference Efficiency of Large Language Models. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023. pages 6342-6353, Association for Computational Linguistics, 2023. [doi]

Abstract

Abstract is missing.