Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation

Zhewei Yao, Xiaoxia Wu, Cheng Li 0001, Stephen Youn, Yuxiong He. Exploring Post-training Quantization in LLMs from Comprehensive Study to Low Rank Compensation. In Michael J. Wooldridge, Jennifer G. Dy, Sriraam Natarajan, editors, Thirty-Eigth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada. pages 19377-19385, AAAI Press, 2024. [doi]

Authors

Zhewei Yao

This author has not been identified. Look up 'Zhewei Yao' in Google

Xiaoxia Wu

This author has not been identified. Look up 'Xiaoxia Wu' in Google

Cheng Li 0001

This author has not been identified. Look up 'Cheng Li 0001' in Google

Stephen Youn

This author has not been identified. Look up 'Stephen Youn' in Google

Yuxiong He

This author has not been identified. Look up 'Yuxiong He' in Google