Ultra-Low Precision 4-bit Training of Deep Neural Networks

Xiao Sun, Naigang Wang, Chia-Yu Chen, Jiamin Ni, Ankur Agrawal, Xiaodong Cui, Swagath Venkataramani, Kaoutar El Maghraoui, Vijayalakshmi Srinivasan, Kailash Gopalakrishnan. Ultra-Low Precision 4-bit Training of Deep Neural Networks. In Hugo Larochelle, Marc'Aurelio Ranzato, Raia Hadsell, Maria-Florina Balcan, Hsuan-Tien Lin, editors, Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual. 2020. [doi]

@inproceedings{SunWCNACVMSG20,
  title = {Ultra-Low Precision 4-bit Training of Deep Neural Networks},
  author = {Xiao Sun and Naigang Wang and Chia-Yu Chen and Jiamin Ni and Ankur Agrawal and Xiaodong Cui and Swagath Venkataramani and Kaoutar El Maghraoui and Vijayalakshmi Srinivasan and Kailash Gopalakrishnan},
  year = {2020},
  url = {https://proceedings.neurips.cc/paper/2020/hash/13b919438259814cd5be8cb45877d577-Abstract.html},
  researchr = {https://researchr.org/publication/SunWCNACVMSG20},
  cites = {0},
  citedby = {0},
  booktitle = {Advances in Neural Information Processing Systems 33: Annual Conference on Neural Information Processing Systems 2020, NeurIPS 2020, December 6-12, 2020, virtual},
  editor = {Hugo Larochelle and Marc'Aurelio Ranzato and Raia Hadsell and Maria-Florina Balcan and Hsuan-Tien Lin},
}