An Optimization Pass for Training Speed-Up and Strategy Search in 3D Parallelism

Ryubu Hosoki, Kento Sato, Toshio Endo, Julien Bigot, Edouard Audit. An Optimization Pass for Training Speed-Up and Strategy Search in 3D Parallelism. In IEEE International Conference on Cluster Computing, CLUSTER - Workshops 2024, Kobe, Japan, September 24-27, 2024. pages 146-147, IEEE, 2024. [doi]

Authors

Ryubu Hosoki

This author has not been identified. Look up 'Ryubu Hosoki' in Google

Kento Sato

This author has not been identified. Look up 'Kento Sato' in Google

Toshio Endo

This author has not been identified. Look up 'Toshio Endo' in Google

Julien Bigot

This author has not been identified. Look up 'Julien Bigot' in Google

Edouard Audit

This author has not been identified. Look up 'Edouard Audit' in Google