SOFT: Softmax-free Transformer with Linear Complexity - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Jiachen Lu, Jinghan Yao, Junge Zhang, Xiatian Zhu, Hang Xu, Weiguo Gao, Chunjing Xu, Tao Xiang, Li Zhang. SOFT: Softmax-free Transformer with Linear Complexity. In Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, Jennifer Wortman Vaughan, editors, Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6-14, 2021, virtual. pages 21297-21309, 2021. [doi]

This author has not been identified. Look up 'Jiachen Lu' in GoogleThis author has not been identified. Look up 'Jinghan Yao' in GoogleThis author has not been identified. Look up 'Junge Zhang' in GoogleThis author has not been identified. Look up 'Xiatian Zhu' in GoogleThis author has not been identified. Look up 'Hang Xu' in GoogleThis author has not been identified. Look up 'Weiguo Gao' in GoogleThis author has not been identified. Look up 'Chunjing Xu' in GoogleThis author has not been identified. Look up 'Tao Xiang' in GoogleThis author has not been identified. Look up 'Li Zhang' in Google

runs on WebDSL