Peiyu Liu 0002, Ze-Feng Gao, Xin Zhao 0018, Yipeng Ma, Tao Wang, Ji-Rong Wen. Unlocking Data-free Low-bit Quantization with Matrix Decomposition for KV Cache Compression. In Lun-Wei Ku, Andre Martins, Vivek Srikumar, editors, Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2024, Bangkok, Thailand, August 11-16, 2024. pages 2430-2440, Association for Computational Linguistics, 2024. [doi]
Abstract is missing.