Qi Zhang, Tianqi Du, Haotian Huang, Yifei Wang, Yisen Wang. Look Ahead or Look Around? A Theoretical Comparison Between Autoregressive and Masked Pretraining. In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net, 2024. [doi]
Abstract is missing.