Scaled ReLU Matters for Training Vision Transformers - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Pichao Wang, Xue Wang, Hao Luo, Jingkai Zhou, Zhipeng Zhou, Fan Wang, Hao Li, Rong Jin 0001. Scaled ReLU Matters for Training Vision Transformers. In Thirty-Sixth AAAI Conference on Artificial Intelligence, AAAI 2022, Thirty-Fourth Conference on Innovative Applications of Artificial Intelligence, IAAI 2022, The Twelveth Symposium on Educational Advances in Artificial Intelligence, EAAI 2022 Virtual Event, February 22 - March 1, 2022. pages 2495-2503, AAAI Press, 2022. [doi]

This author has not been identified. Look up 'Pichao Wang' in GoogleThis author has not been identified. Look up 'Xue Wang' in GoogleThis author has not been identified. Look up 'Hao Luo' in GoogleThis author has not been identified. Look up 'Jingkai Zhou' in GoogleThis author has not been identified. Look up 'Zhipeng Zhou' in GoogleThis author has not been identified. Look up 'Fan Wang' in GoogleThis author has not been identified. Look up 'Hao Li' in GoogleThis author has not been identified. Look up 'Rong Jin 0001' in Google

runs on WebDSL