Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge

Ian Porada, Alessandro Sordoni, Jackie Chi Kit Cheung. Does Pre-training Induce Systematic Inference? How Masked Language Models Acquire Commonsense Knowledge. In Marine Carpuat, Marie-Catherine de Marneffe, Iván Vladimir Meza Ruíz, editors, Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL 2022, Seattle, WA, United States, July 10-15, 2022. pages 4550-4557, Association for Computational Linguistics, 2022. [doi]

Authors

Ian Porada

This author has not been identified. Look up 'Ian Porada' in Google

Alessandro Sordoni

This author has not been identified. Look up 'Alessandro Sordoni' in Google

Jackie Chi Kit Cheung

This author has not been identified. Look up 'Jackie Chi Kit Cheung' in Google