SOLE: Hardware-Software Co-design of Softmax and LayerNorm for Efficient Transformer Inference

Wenxun Wang, Shuchang Zhou 0001, Wenyu Sun, Peiqin Sun, Yongpan Liu. SOLE: Hardware-Software Co-design of Softmax and LayerNorm for Efficient Transformer Inference. In IEEE/ACM International Conference on Computer Aided Design, ICCAD 2023, San Francisco, CA, USA, October 28 - Nov. 2, 2023. pages 1-9, IEEE, 2023. [doi]

Authors

Wenxun Wang

This author has not been identified. Look up 'Wenxun Wang' in Google

Shuchang Zhou 0001

This author has not been identified. Look up 'Shuchang Zhou 0001' in Google

Wenyu Sun

This author has not been identified. Look up 'Wenyu Sun' in Google

Peiqin Sun

This author has not been identified. Look up 'Peiqin Sun' in Google

Yongpan Liu

This author has not been identified. Look up 'Yongpan Liu' in Google