An Optimization Pass for Training Speed-Up and Strategy Search in 3D Parallelism

Ryubu Hosoki, Kento Sato, Toshio Endo, Julien Bigot, Edouard Audit. An Optimization Pass for Training Speed-Up and Strategy Search in 3D Parallelism. In IEEE International Conference on Cluster Computing, CLUSTER - Workshops 2024, Kobe, Japan, September 24-27, 2024. pages 146-147, IEEE, 2024. [doi]

Abstract

Abstract is missing.