Distributed Training of Large Language Models

Fanlong Zeng, Wensheng Gan, Yongheng Wang, Philip S. Yu. Distributed Training of Large Language Models. In 29th IEEE International Conference on Parallel and Distributed Systems, ICPADS 2023, Ocean Flower Island, China, December 17-21, 2023. pages 840-847, IEEE, 2023. [doi]

Abstract

Abstract is missing.