Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models

Yubin Shi, Yixuan Chen 0003, Mingzhi Dong, Xiaochen Yang, Dongsheng Li, Yujiang Wang 0001, Robert P. Dick, Qin Lv, Yingying Zhao, Fan Yang 0001, Tun Lu, Ning Gu, Li Shang. Train Faster, Perform Better: Modular Adaptive Training in Over-Parameterized Models. In Alice Oh, Tristan Naumann, Amir Globerson, Kate Saenko, Moritz Hardt, Sergey Levine, editors, Advances in Neural Information Processing Systems 36: Annual Conference on Neural Information Processing Systems 2023, NeurIPS 2023, New Orleans, LA, USA, December 10 - 16, 2023. 2023. [doi]

Abstract

Abstract is missing.