NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Yilong Chen, Guoxia Wang, Junyuan Shang, Shiyao Cui, Zhenyu Zhang 0006, Tingwen Liu, Shuohuan Wang, Yu Sun, Dianhai Yu, Hua Wu 0003. NACL: A General and Effective KV Cache Eviction Framework for LLM at Inference Time. In Lun-Wei Ku, Andre Martins, Vivek Srikumar, editors, Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024. pages 7913-7926, Association for Computational Linguistics, 2024. [doi]

This author has not been identified. Look up 'Yilong Chen' in GoogleThis author has not been identified. Look up 'Guoxia Wang' in GoogleThis author has not been identified. Look up 'Junyuan Shang' in GoogleThis author has not been identified. Look up 'Shiyao Cui' in GoogleThis author has not been identified. Look up 'Zhenyu Zhang 0006' in GoogleThis author has not been identified. Look up 'Tingwen Liu' in GoogleThis author has not been identified. Look up 'Shuohuan Wang' in GoogleThis author has not been identified. Look up 'Yu Sun' in GoogleThis author has not been identified. Look up 'Dianhai Yu' in GoogleThis author has not been identified. Look up 'Hua Wu 0003' in Google

runs on WebDSL