Adaptive Gradient Quantization for Data-Parallel SGD

Fartash Faghri, Iman Tabrizian, Ilia Markov, Dan Alistarh, Daniel M. Roy 0001, Ali Ramezani-Kebrya. Adaptive Gradient Quantization for Data-Parallel SGD. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual. 2020. [doi]

Authors

Fartash Faghri

This author has not been identified. Look up 'Fartash Faghri' in Google

Iman Tabrizian

This author has not been identified. Look up 'Iman Tabrizian' in Google

Ilia Markov

This author has not been identified. Look up 'Ilia Markov' in Google

Dan Alistarh

This author has not been identified. Look up 'Dan Alistarh' in Google

Daniel M. Roy 0001

This author has not been identified. Look up 'Daniel M. Roy 0001' in Google

Ali Ramezani-Kebrya

This author has not been identified. Look up 'Ali Ramezani-Kebrya' in Google