Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training

Shiwei Liu, Lu Yin, Decebal Constantin Mocanu, Mykola Pechenizkiy. Do We Actually Need Dense Over-Parameterization? In-Time Over-Parameterization in Sparse Training. In Marina Meila, Tong Zhang 0001, editors, Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18-24 July 2021, Virtual Event. Volume 139 of Proceedings of Machine Learning Research, pages 6989-7000, PMLR, 2021. [doi]

Authors

Shiwei Liu

This author has not been identified. Look up 'Shiwei Liu' in Google

Lu Yin

This author has not been identified. Look up 'Lu Yin' in Google

Decebal Constantin Mocanu

This author has not been identified. Look up 'Decebal Constantin Mocanu' in Google

Mykola Pechenizkiy

This author has not been identified. It may be one of the following persons: Look up 'Mykola Pechenizkiy' in Google