Layer-Parallel Training with GPU Concurrency of Deep Residual Neural Networks via Nonlinear Multigrid

Andrew C. Kirby, Siddharth Samsi, Michael Jones 0001, Albert Reuther, Jeremy Kepner, Vijay Gadepally. Layer-Parallel Training with GPU Concurrency of Deep Residual Neural Networks via Nonlinear Multigrid. In 2020 IEEE High Performance Extreme Computing Conference, HPEC 2020, Waltham, MA, USA, September 22-24, 2020. pages 1-7, IEEE, 2020. [doi]

Abstract

Abstract is missing.