Jaeyong Song, Jinkyu Yim, Jaewon Jung, Hongsun Jang, Hyung Jin Kim, Youngsok Kim, Jinho Lee. Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression. In Tor M. Aamodt, Natalie D. Enright Jerger, Michael M. Swift, editors, Proceedings of the 28th ACM International Conference on Architectural Support for Programming Languages and Operating Systems, Volume 2, ASPLOS 2023, Vancouver, BC, Canada, March 25-29, 2023. pages 560-573, ACM, 2023. [doi]
Abstract is missing.