Learning and Evaluating a Differentially Private Pre-trained Language Model

Shlomo Hoory, Amir Feder, Avichai Tendler, Sofia Erell, Alon Peled-Cohen, Itay Laish, Hootan Nakhost, Uri Stemmer, Ayelet Benjamini, Avinatan Hassidim, Yossi Matias. Learning and Evaluating a Differentially Private Pre-trained Language Model. In Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih, editors, Findings of the Association for Computational Linguistics: EMNLP 2021, Virtual Event / Punta Cana, Dominican Republic, 16-20 November, 2021. pages 1178-1189, Association for Computational Linguistics, 2021. [doi]

Abstract

Abstract is missing.