SOLE: Hardware-Software Co-design of Softmax and LayerNorm for Efficient Transformer Inference

Wenxun Wang, Shuchang Zhou 0001, Wenyu Sun, Peiqin Sun, Yongpan Liu. SOLE: Hardware-Software Co-design of Softmax and LayerNorm for Efficient Transformer Inference. In IEEE/ACM International Conference on Computer Aided Design, ICCAD 2023, San Francisco, CA, USA, October 28 - Nov. 2, 2023. pages 1-9, IEEE, 2023. [doi]

@inproceedings{WangZSSL23,
  title = {SOLE: Hardware-Software Co-design of Softmax and LayerNorm for Efficient Transformer Inference},
  author = {Wenxun Wang and Shuchang Zhou 0001 and Wenyu Sun and Peiqin Sun and Yongpan Liu},
  year = {2023},
  doi = {10.1109/ICCAD57390.2023.10323725},
  url = {https://doi.org/10.1109/ICCAD57390.2023.10323725},
  researchr = {https://researchr.org/publication/WangZSSL23},
  cites = {0},
  citedby = {0},
  pages = {1-9},
  booktitle = {IEEE/ACM International Conference on Computer Aided Design, ICCAD 2023, San Francisco, CA, USA, October 28 - Nov. 2, 2023},
  publisher = {IEEE},
  isbn = {979-8-3503-2225-5},
}