Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Xuan Shen, Peiyan Dong, Lei Lu, Zhenglun Kong, Zhengang Li, Ming Lin, Chao Wu, Yanzhi Wang. Agile-Quant: Activation-Guided Quantization for Faster Inference of LLMs on the Edge. In Michael J. Wooldridge, Jennifer G. Dy, Sriraam Natarajan, editors, Thirty-Eigth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada. pages 18944-18951, AAAI Press, 2024. [doi]

This author has not been identified. Look up 'Xuan Shen' in GoogleThis author has not been identified. Look up 'Peiyan Dong' in GoogleThis author has not been identified. Look up 'Lei Lu' in GoogleThis author has not been identified. Look up 'Zhenglun Kong' in GoogleThis author has not been identified. Look up 'Zhengang Li' in GoogleThis author has not been identified. Look up 'Ming Lin' in GoogleThis author has not been identified. Look up 'Chao Wu' in GoogleThis author has not been identified. Look up 'Yanzhi Wang' in Google

runs on WebDSL