ULSeq-TA: Ultra-Long Sequence Attention Fusion Transformer Accelerator Supporting Grouped Sparse Softmax and Dual-Path Sparse LayerNorm - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Jingyu Wang, Lu Zhang, Xueqing Li, Huazhong Yang, Yongpan Liu. ULSeq-TA: Ultra-Long Sequence Attention Fusion Transformer Accelerator Supporting Grouped Sparse Softmax and Dual-Path Sparse LayerNorm. IEEE Trans. on CAD of Integrated Circuits and Systems, 43(3):892-905, March 2024. [doi]

This author has not been identified. Look up 'Jingyu Wang' in GoogleThis author has not been identified. Look up 'Lu Zhang' in GoogleThis author has not been identified. Look up 'Xueqing Li' in GoogleThis author has not been identified. Look up 'Huazhong Yang' in GoogleThis author has not been identified. Look up 'Yongpan Liu' in Google

runs on WebDSL