Transferring Knowledge From Large Foundation Models to Small Downstream Models

Shikai Qiu, Boran Han, Danielle C. Maddix, Shuai Zhang, Bernie Wang 0001, Andrew Gordon Wilson. Transferring Knowledge From Large Foundation Models to Small Downstream Models. In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net, 2024. [doi]

Abstract

Abstract is missing.