SUPER: SUb-Graph Parallelism for TransformERs

Arpan Jain, Tim Moon, Tom Benson, Hari Subramoni, Sam Adé Jacobs, Dhabaleswar K. Panda 0001, Brian Van Essen. SUPER: SUb-Graph Parallelism for TransformERs. In 35th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2021, Portland, OR, USA, May 17-21, 2021. pages 629-638, IEEE, 2021. [doi]

Abstract

Abstract is missing.