Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Boxin Wang, Wei Ping, Peng Xu, Lawrence McAfee, Zihan Liu, Mohammad Shoeybi, Yi Dong, Oleksii Kuchaiev, Bo Li, Chaowei Xiao, Anima Anandkumar, Bryan Catanzaro. Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, EMNLP 2023, Singapore, December 6-10, 2023. pages 7763-7786, Association for Computational Linguistics, 2023. [doi]

This author has not been identified. Look up 'Boxin Wang' in GoogleThis author has not been identified. Look up 'Wei Ping' in GoogleThis author has not been identified. Look up 'Peng Xu' in GoogleThis author has not been identified. Look up 'Lawrence McAfee' in GoogleThis author has not been identified. Look up 'Zihan Liu' in GoogleThis author has not been identified. Look up 'Mohammad Shoeybi' in GoogleThis author has not been identified. Look up 'Yi Dong' in GoogleThis author has not been identified. Look up 'Oleksii Kuchaiev' in GoogleThis author has not been identified. Look up 'Bo Li' in GoogleThis author has not been identified. Look up 'Chaowei Xiao' in GoogleThis author has not been identified. Look up 'Anima Anandkumar' in GoogleThis author has not been identified. Look up 'Bryan Catanzaro' in Google

runs on WebDSL