Luca Saglietti, Lenka Zdeborová. Solvable Model for Inheriting the Regularization through Knowledge Distillation. In Joan Bruna, Jan S. Hesthaven, Lenka Zdeborová, editors, Mathematical and Scientific Machine Learning, 16-19 August 2021, Virtual Conference / Lausanne, Switzerland. Volume 145 of Proceedings of Machine Learning Research, pages 809-846, PMLR, 2021. [doi]
Abstract is missing.