Demystifying the Communication Characteristics for Distributed Transformer Models

Quentin Anthony, Benjamin Michalowicz, Jacob Hatef, Lang Xu, Mustafa Abdul Jabbar, Aamir Shafi, Hari Subramoni, Dhabaleswar K. Panda 0001. Demystifying the Communication Characteristics for Distributed Transformer Models. In IEEE Symposium on High-Performance Interconnects, HOTI 2024, Albuquerque, NM, USA, August 21-23, 2024. pages 57-65, IEEE, 2024. [doi]

Authors

Quentin Anthony

This author has not been identified. Look up 'Quentin Anthony' in Google

Benjamin Michalowicz

This author has not been identified. Look up 'Benjamin Michalowicz' in Google

Jacob Hatef

This author has not been identified. Look up 'Jacob Hatef' in Google

Lang Xu

This author has not been identified. Look up 'Lang Xu' in Google

Mustafa Abdul Jabbar

This author has not been identified. Look up 'Mustafa Abdul Jabbar' in Google

Aamir Shafi

This author has not been identified. Look up 'Aamir Shafi' in Google

Hari Subramoni

This author has not been identified. Look up 'Hari Subramoni' in Google

Dhabaleswar K. Panda 0001

This author has not been identified. Look up 'Dhabaleswar K. Panda 0001' in Google