Ryubu Hosoki, Toshio Endo, Takahiro Hirofuchi, Tsutomu Ikegami. AshPipe: Asynchronous Hybrid Pipeline Parallel for DNN Training. In Proceedings of the International Conference on High Performance Computing in Asia-Pacific Region, HPCAsia 2024, Nagoya, Japan, January 25-27, 2024. pages 117-126, ACM, 2024. [doi]
Abstract is missing.