Accounting for Variance in Machine Learning Benchmarks

Xavier Bouthillier, Pierre Delaunay, Mirko Bronzi, Assya Trofimov, Brennan Nichyporuk, Justin Szeto, Nazanin Mohammadi Sepahvand, Edward Raff, Kanika Madan, Vikram Voleti, Samira Ebrahimi Kahou, Vincent Michalski, Tal Arbel, Chris Pal, Gaël Varoquaux, Pascal Vincent. Accounting for Variance in Machine Learning Benchmarks. In Alex Smola, Alex Dimakis, Ion Stoica, editors, Proceedings of Machine Learning and Systems 2021, MLSys 2021, virtual, April 5-9, 2021. mlsys.org, 2021. [doi]

@inproceedings{BouthillierDBTN21,
  title = {Accounting for Variance in Machine Learning Benchmarks},
  author = {Xavier Bouthillier and Pierre Delaunay and Mirko Bronzi and Assya Trofimov and Brennan Nichyporuk and Justin Szeto and Nazanin Mohammadi Sepahvand and Edward Raff and Kanika Madan and Vikram Voleti and Samira Ebrahimi Kahou and Vincent Michalski and Tal Arbel and Chris Pal and Gaël Varoquaux and Pascal Vincent},
  year = {2021},
  url = {https://proceedings.mlsys.org/paper/2021/hash/cfecdb276f634854f3ef915e2e980c31-Abstract.html},
  researchr = {https://researchr.org/publication/BouthillierDBTN21},
  cites = {0},
  citedby = {0},
  booktitle = {Proceedings of Machine Learning and Systems 2021, MLSys 2021, virtual, April 5-9, 2021},
  editor = {Alex Smola and Alex Dimakis and Ion Stoica},
  publisher = {mlsys.org},
}