Kaiyue Wen, Zhiyuan Li 0005, Jason S. Wang, David Leo Wright Hall, Percy Liang, Tengyu Ma 0001. Understanding Warmup-Stable-Decay Learning Rates: A River Valley Loss Landscape View. In The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025. OpenReview.net, 2025. [doi]
Abstract is missing.