Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity

Chulhee Yun, Suvrit Sra, Ali Jadbabaie. Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity. In Hanna M. Wallach, Hugo Larochelle, Alina Beygelzimer, Florence d'Alché-Buc, Edward A. Fox, Roman Garnett, editors, Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, 8-14 December 2019, Vancouver, BC, Canada. pages 15532-15543, 2019. [doi]

@inproceedings{YunSJ19-0,
  title = {Small ReLU networks are powerful memorizers: a tight analysis of memorization capacity},
  author = {Chulhee Yun and Suvrit Sra and Ali Jadbabaie},
  year = {2019},
  url = {http://papers.nips.cc/paper/9688-small-relu-networks-are-powerful-memorizers-a-tight-analysis-of-memorization-capacity},
  researchr = {https://researchr.org/publication/YunSJ19-0},
  cites = {0},
  citedby = {0},
  pages = {15532-15543},
  booktitle = {Advances in Neural Information Processing Systems 32: Annual Conference on Neural Information Processing Systems 2019, NeurIPS 2019, 8-14 December 2019, Vancouver, BC, Canada},
  editor = {Hanna M. Wallach and Hugo Larochelle and Alina Beygelzimer and Florence d'Alché-Buc and Edward A. Fox and Roman Garnett},
}