Retrieval-Augmented Generation with Quantized Large Language Models: A Comparative Analysis

Shanglin Yang, Jialin Zhu, Jialin Wang, Xiaohan Xu, Zihang Shao, Liwei Yao, Benchang Zheng, Hu Huang. Retrieval-Augmented Generation with Quantized Large Language Models: A Comparative Analysis. In Proceedings of the 5th International Conference on Internet of Things, Automation and Artificial Intelligence, IoTAAI 2023, Nanchang, China, November 24-26, 2023. pages 120-124, ACM, 2023. [doi]

Abstract

Abstract is missing.