Accelerate Model Parallel Deep Learning Training Using Effective Graph Traversal Order in Device Placement

TianZe Wang, Amir Hossein Payberah, Desta Haileselassie Hagos, Vladimir Vlassov. Accelerate Model Parallel Deep Learning Training Using Effective Graph Traversal Order in Device Placement. In David M. Eyers, Spyros Voulgaris, editors, Distributed Applications and Interoperable Systems: 22nd IFIP WG 6.1 International Conference, DAIS 2022, Held as Part of the 17th International Federated Conference on Distributed Computing Techniques, DisCoTec 2022, Lucca, Italy, June 13-17, 2022, Proceedings. Volume 13272 of Lecture Notes in Computer Science, pages 114-130, Springer, 2022. [doi]

Abstract

Abstract is missing.