LAGA: Lagged AllReduce with Gradient Accumulation for Minimal Idle Time

Ido Hakimi, Rotem Zamir Aviv, Kfir Y. Levy, Assaf Schuster. LAGA: Lagged AllReduce with Gradient Accumulation for Minimal Idle Time. In James Bailey 0001, Pauli Miettinen, Yun Sing Koh, Dacheng Tao, Xindong Wu 0001, editors, IEEE International Conference on Data Mining, ICDM 2021, Auckland, New Zealand, December 7-10, 2021. pages 171-180, IEEE, 2021. [doi]

Abstract

Abstract is missing.