On Orthogonality Constraints for Transformers

Aston Zhang, Alvin Chan, Yi Tay, Jie Fu, Shuohang Wang, Shuai Zhang 0007, Huajie Shao, Shuochao Yao, Roy Ka-Wei Lee. On Orthogonality Constraints for Transformers. In Chengqing Zong, Fei Xia, Wenjie Li 0002, Roberto Navigli, editors, Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 2: Short Papers), Virtual Event, August 1-6, 2021. pages 375-382, Association for Computational Linguistics, 2021. [doi]

Authors

Aston Zhang

This author has not been identified. Look up 'Aston Zhang' in Google

Alvin Chan

This author has not been identified. Look up 'Alvin Chan' in Google

Yi Tay

This author has not been identified. Look up 'Yi Tay' in Google

Jie Fu

This author has not been identified. Look up 'Jie Fu' in Google

Shuohang Wang

This author has not been identified. Look up 'Shuohang Wang' in Google

Shuai Zhang 0007

This author has not been identified. Look up 'Shuai Zhang 0007' in Google

Huajie Shao

This author has not been identified. Look up 'Huajie Shao' in Google

Shuochao Yao

This author has not been identified. Look up 'Shuochao Yao' in Google

Roy Ka-Wei Lee

This author has not been identified. Look up 'Roy Ka-Wei Lee' in Google