Mert Yazan, Suzan Verberne, Frederik Situmeang. The Impact of Quantization on Retrieval-Augmented Generation: An Analysis of Small LLMs. In Fabio Petroni, Federico Siciliano, Fabrizio Silvestri, Giovanni Trappolini, editors, Proceedings of the Workshop Information Retrieval's Role in RAG Systems (IR-RAG 2024) co-located with the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR 2024), Washington DC, USA, 07 18, 2024. Volume 3784 of CEUR Workshop Proceedings, pages 77-81, CEUR-WS.org, 2024. [doi]
Abstract is missing.