Ultra-Low Precision 4-bit Training of Deep Neural Networks

Xiao Sun, Naigang Wang, Chia-Yu Chen, Jiamin Ni, Ankur Agrawal, Xiaodong Cui, Swagath Venkataramani, Kaoutar El Maghraoui, Vijayalakshmi Srinivasan, Kailash Gopalakrishnan. Ultra-Low Precision 4-bit Training of Deep Neural Networks. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual. 2020. [doi]

Authors

Xiao Sun

This author has not been identified. Look up 'Xiao Sun' in Google

Naigang Wang

This author has not been identified. Look up 'Naigang Wang' in Google

Chia-Yu Chen

This author has not been identified. Look up 'Chia-Yu Chen' in Google

Jiamin Ni

This author has not been identified. Look up 'Jiamin Ni' in Google

Ankur Agrawal

This author has not been identified. Look up 'Ankur Agrawal' in Google

Xiaodong Cui

This author has not been identified. Look up 'Xiaodong Cui' in Google

Swagath Venkataramani

This author has not been identified. Look up 'Swagath Venkataramani' in Google

Kaoutar El Maghraoui

This author has not been identified. Look up 'Kaoutar El Maghraoui' in Google

Vijayalakshmi Srinivasan

This author has not been identified. Look up 'Vijayalakshmi Srinivasan' in Google

Kailash Gopalakrishnan

This author has not been identified. Look up 'Kailash Gopalakrishnan' in Google