EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models

Jialiang Cheng, Ning Gao, Yun Yue, Zhiling Ye, Jiadi Jiang, Jian Sha. EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models. In The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net, 2025. [doi]

@inproceedings{ChengGYYJS25,
  title = {EDiT: A Local-SGD-Based Efficient Distributed Training Method for Large Language Models},
  author = {Jialiang Cheng and Ning Gao and Yun Yue and Zhiling Ye and Jiadi Jiang and Jian Sha},
  year = {2025},
  url = {https://openreview.net/forum?id=xtlMtbVfWu},
  researchr = {https://researchr.org/publication/ChengGYYJS25},
  cites = {0},
  citedby = {0},
  booktitle = {The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025},
  publisher = {OpenReview.net},
}