Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam

Yucheng Lu, Conglong Li, Minjia Zhang, Christopher De Sa, Yuxiong He. Maximizing Communication Efficiency for Large-scale Training via 0/1 Adam. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023. [doi]

Abstract

Abstract is missing.