IBing: An Efficient Interleaved Bidirectional Ring All-Reduce Algorithm for Gradient Synchronization

Ruixing Zong, Jiapeng Zhang, Zhuo Tang, Kenli Li 0001. IBing: An Efficient Interleaved Bidirectional Ring All-Reduce Algorithm for Gradient Synchronization. TACO, 22(1), March 2025. [doi]

Abstract

Abstract is missing.