Exponential Graph is Provably Efficient for Decentralized Deep Training

Bicheng Ying, Kun Yuan, Yiming Chen 0003, Hanbin Hu, Pan Pan, Wotao Yin. Exponential Graph is Provably Efficient for Decentralized Deep Training. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 13975-13987, 2021. [doi]

Abstract

Abstract is missing.