Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training

Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy. Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training. In Marina Meila, Tong Zhang 0001, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event. Volume 139 of Proceedings of Machine Learning Research, pages 6989-7000, PMLR, 2021. [doi]

@inproceedings{LiuYMP21,
  title = {Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training},
  author = {Shiwei Liu and Lu Yin and Decebal Constantin Mocanu and Mykola Pechenizkiy},
  year = {2021},
  url = {http://proceedings.mlr.press/v139/liu21y.html},
  researchr = {https://researchr.org/publication/LiuYMP21},
  cites = {0},
  citedby = {0},
  pages = {6989-7000},
  booktitle = {Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event},
  editor = {Marina Meila and Tong Zhang 0001},
  volume = {139},
  series = {Proceedings of Machine Learning Research},
  publisher = {PMLR},
}