A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta

Maksim Velikanov, Denis Kuznedelev, Dmitry Yarotsky. A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta. In The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023. OpenReview.net, 2023. [doi]

@inproceedings{VelikanovKY23,
  title = {A view of mini-batch SGD via generating functions: conditions of convergence, phase transitions, benefit from negative momenta},
  author = {Maksim Velikanov and Denis Kuznedelev and Dmitry Yarotsky},
  year = {2023},
  url = {https://openreview.net/pdf?id=bzaPGEllsjE},
  researchr = {https://researchr.org/publication/VelikanovKY23},
  cites = {0},
  citedby = {0},
  booktitle = {The Eleventh International Conference on Learning Representations, ICLR 2023, Kigali, Rwanda, May 1-5, 2023},
  publisher = {OpenReview.net},
}