ESRU: Extremely Low-Bit and Hardware-Efficient Stochastic Rounding Unit Design for Low-Bit DNN Training

Sung-En Chang, Geng Yuan, Alec Lu, Mengshu Sun, Yanyu Li, Xiaolong Ma, Zhengang Li, Yanyue Xie, Minghai Qin, Xue Lin, Zhenman Fang, Yanzhi Wang. ESRU: Extremely Low-Bit and Hardware-Efficient Stochastic Rounding Unit Design for Low-Bit DNN Training. In Design, Automation & Test in Europe Conference & Exhibition, DATE 2023, Antwerp, Belgium, April 17-19, 2023. pages 1-6, IEEE, 2023. [doi]

Authors

Sung-En Chang

This author has not been identified. Look up 'Sung-En Chang' in Google

Geng Yuan

This author has not been identified. Look up 'Geng Yuan' in Google

Alec Lu

This author has not been identified. Look up 'Alec Lu' in Google

Mengshu Sun

This author has not been identified. Look up 'Mengshu Sun' in Google

Yanyu Li

This author has not been identified. Look up 'Yanyu Li' in Google

Xiaolong Ma

This author has not been identified. Look up 'Xiaolong Ma' in Google

Zhengang Li

This author has not been identified. Look up 'Zhengang Li' in Google

Yanyue Xie

This author has not been identified. Look up 'Yanyue Xie' in Google

Minghai Qin

This author has not been identified. Look up 'Minghai Qin' in Google

Xue Lin

This author has not been identified. Look up 'Xue Lin' in Google

Zhenman Fang

This author has not been identified. Look up 'Zhenman Fang' in Google

Yanzhi Wang

This author has not been identified. Look up 'Yanzhi Wang' in Google