OASR-WFBP: An overlapping aware start-up sharing gradient merging strategy for efficient communication in distributed deep learning

Yingjie Song, Zhuo Tang, Yaohua Wang, Xiong Xiao, Zhizhong Liu, Jing Xia, Kenli Li 0001. OASR-WFBP: An overlapping aware start-up sharing gradient merging strategy for efficient communication in distributed deep learning. J. Parallel Distrib. Comput., 196:104997, 2025. [doi]

Abstract

Abstract is missing.