A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta

Maksim Velikanov, Denis Kuznedelev, Dmitry Yarotsky. A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023. [doi]

Abstract

Abstract is missing.