BlueConnect: Decomposing All-Reduce for Deep Learning on Heterogeneous Network Hierarchy

Minsik Cho, Ulrich Finkler, David S. Kung 0001, Hillery C. Hunter. BlueConnect: Decomposing All-Reduce for Deep Learning on Heterogeneous Network Hierarchy. In Ameet Talwalkar, Virginia Smith, Matei Zaharia, editors, Proceedings of Machine Learning and Systems 2019, MLSys 2019, Stanford, CA, USA, March 31 - April 2, 2019. mlsys.org, 2019. [doi]

Abstract

Abstract is missing.