Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance

Zhuoning Yuan, Yuexin Wu, Zi-Hao Qiu, Xianzhi Du, Lijun Zhang, Denny Zhou, Tianbao Yang. Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance. In Kamalika Chaudhuri, Stefanie Jegelka, Le Song, Csaba Szepesvári, Gang Niu 0001, Sivan Sabato, editors, International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA. Volume 162 of Proceedings of Machine Learning Research, pages 25760-25782, PMLR, 2022. [doi]

@inproceedings{YuanWQDZZY22,
  title = {Provable Stochastic Optimization for Global Contrastive Learning: Small Batch Does Not Harm Performance},
  author = {Zhuoning Yuan and Yuexin Wu and Zi-Hao Qiu and Xianzhi Du and Lijun Zhang and Denny Zhou and Tianbao Yang},
  year = {2022},
  url = {https://proceedings.mlr.press/v162/yuan22b.html},
  researchr = {https://researchr.org/publication/YuanWQDZZY22},
  cites = {0},
  citedby = {0},
  pages = {25760-25782},
  booktitle = {International Conference on Machine Learning, ICML 2022, 17-23 July 2022, Baltimore, Maryland, USA},
  editor = {Kamalika Chaudhuri and Stefanie Jegelka and Le Song and Csaba Szepesvári and Gang Niu 0001 and Sivan Sabato},
  volume = {162},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
}