Rethinking Learning Rate Tuning in the Era of Large Language Models

Hongpeng Jin, Wenqi Wei, Xuyu Wang, Wenbin Zhang 0002, Yanzhao Wu 0001. Rethinking Learning Rate Tuning in the Era of Large Language Models. In 5th IEEE International Conference on Cognitive Machine Intelligence, CogMI 2023, Atlanta, GA, USA, November 1-4, 2023. pages 112-121, IEEE, 2023. [doi]

Abstract

Abstract is missing.