Jacob R. Stevens, Rangharajan Venkatesan, Steve Dai, Brucek Khailany, Anand Raghunathan. Softermax: Hardware/Software Co-Design of an Efficient Softmax for Transformers. In 58th ACM/IEEE Design Automation Conference, DAC 2021, San Francisco, CA, USA, December 5-9, 2021. pages 469-474, IEEE, 2021. [doi]
Abstract is missing.