Knowledge Distillation as Semiparametric Inference

Tri Dao, Govinda M. Kamath, Vasilis Syrgkanis, Lester Mackey. Knowledge Distillation as Semiparametric Inference. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. [doi]

Abstract

Abstract is missing.