Metadata Conditioning Accelerates Language Model Pre-training

Tianyu Gao 0001, Alexander Wettig, Luxi He, Yihe Dong, Sadhika Malladi, Danqi Chen 0001. Metadata Conditioning Accelerates Language Model Pre-training. In Forty-second International Conference on Machine Learning, ICML 2025, Vancouver, BC, Canada, July 13-19, 2025. OpenReview.net, 2025. [doi]

Abstract

Abstract is missing.