SmartPipe: Intelligently Freezing Layers in Pipeline Parallelism for Distributed DNN Training

Nadia Niknami, Abdalaziz Sawwan, Jie Wu 0001. SmartPipe: Intelligently Freezing Layers in Pipeline Parallelism for Distributed DNN Training. In 29th IEEE International Conference on Parallel and Distributed Systems, ICPADS 2023, Ocean Flower Island, China, December 17-21, 2023. pages 1885-1894, IEEE, 2023. [doi]

Abstract

Abstract is missing.