The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles

Md. Shamim Hussain, Mohammed J. Zaki, Dharmashankar Subramanian. The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles. In Ambuj Singh, Yizhou Sun, Leman Akoglu, Dimitrios Gunopulos, Xifeng Yan, Ravi Kumar 0001, Fatma Ozcan, Jieping Ye, editors, Proceedings of the 29th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, KDD 2023, Long Beach, CA, USA, August 6-10, 2023. pages 810-821, ACM, 2023. [doi]

Authors

Md. Shamim Hussain

This author has not been identified. Look up 'Md. Shamim Hussain' in Google

Mohammed J. Zaki

This author has not been identified. Look up 'Mohammed J. Zaki' in Google

Dharmashankar Subramanian

This author has not been identified. Look up 'Dharmashankar Subramanian' in Google