SUPER: SUb-Graph Parallelism for TransformERs

Arpan Jain, Tim Moon, Tom Benson, Hari Subramoni, Sam Adé Jacobs, Dhabaleswar K. Panda 0001, Brian Van Essen. SUPER: SUb-Graph Parallelism for TransformERs. In 35th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2021, Portland, OR, USA, May 17-21, 2021. pages 629-638, IEEE, 2021. [doi]

Authors

Arpan Jain

This author has not been identified. Look up 'Arpan Jain' in Google

Tim Moon

This author has not been identified. Look up 'Tim Moon' in Google

Tom Benson

This author has not been identified. Look up 'Tom Benson' in Google

Hari Subramoni

This author has not been identified. Look up 'Hari Subramoni' in Google

Sam Adé Jacobs

This author has not been identified. Look up 'Sam Adé Jacobs' in Google

Dhabaleswar K. Panda 0001

This author has not been identified. Look up 'Dhabaleswar K. Panda 0001' in Google

Brian Van Essen

This author has not been identified. Look up 'Brian Van Essen' in Google