Pre-training Language Models with Deterministic Factual Knowledge

Shaobo Li, Xiaoguang Li, Lifeng Shang, Chengjie Sun, Bingquan Liu, Zhenzhou Ji, Xin Jiang, Qun Liu. Pre-training Language Models with Deterministic Factual Knowledge. In Yoav Goldberg, Zornitsa Kozareva, Yue Zhang, editors, Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, EMNLP 2022, Abu Dhabi, United Arab Emirates, December 7-11. pages 11118-11131, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.