vTrain: A Simulation Framework for Evaluating Cost-Effective and Compute-Optimal Large Language Model Training

Jehyeon Bang, Yujeong Choi, Myeongwoo Kim, Yongdeok Kim, Minsoo Rhu. vTrain: A Simulation Framework for Evaluating Cost-Effective and Compute-Optimal Large Language Model Training. In 57th IEEE/ACM International Symposium on Microarchitecture, MICRO 2024, Austin, TX, USA, November 2-6, 2024. pages 153-167, IEEE, 2024. [doi]

Abstract

Abstract is missing.