Why Is Public Pretraining Necessary for Private Model Training?

Arun Ganesh, Mahdi Haghifam, Milad Nasr, Sewoong Oh, Thomas Steinke 0002, Om Thakkar 0001, Abhradeep Guha Thakurta, Lun Wang. Why Is Public Pretraining Necessary for Private Model Training?. In Andreas Krause 0001, Emma Brunskill, KyungHyun Cho, Barbara Engelhardt, Sivan Sabato, Jonathan Scarlett, editors, International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA. Volume 202 of Proceedings of Machine Learning Research, pages 10611-10627, PMLR, 2023. [doi]

Abstract

Abstract is missing.