Direction Matters: On the Implicit Bias of Stochastic Gradient Descent with Moderate Learning Rate

Jingfeng Wu, Difan Zou, Vladimir Braverman, Quanquan Gu. Direction Matters: On the Implicit Bias of Stochastic Gradient Descent with Moderate Learning Rate. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021. OpenReview.net, 2021. [doi]

@inproceedings{WuZBG21,
  title = {Direction Matters: On the Implicit Bias of Stochastic Gradient Descent with Moderate Learning Rate},
  author = {Jingfeng Wu and Difan Zou and Vladimir Braverman and Quanquan Gu},
  year = {2021},
  url = {https://openreview.net/forum?id=3X64RLgzY6O},
  researchr = {https://researchr.org/publication/WuZBG21},
  cites = {0},
  citedby = {0},
  booktitle = {9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3-7, 2021},
  publisher = {OpenReview.net},
}