The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles

Md. Shamim Hussain, Mohammed J. Zaki, Dharmashankar Subramanian. The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles. In Ambuj Singh, Yizhou Sun, Leman Akoglu, Dimitrios Gunopulos, Xifeng Yan, Ravi Kumar 0001, Fatma Ozcan, Jieping Ye, editors, Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2023, Long Beach, CA, USA, August 6-10, 2023. pages 810-821, ACM, 2023. [doi]

Abstract

Abstract is missing.