Comprehensive Performance Modeling and System Design Insights for Foundation Models

Shashank Subramanian, Ermal Rrapaj, Peter Harrington, Smeet Chheda, Steven Farrell, Brian Austin, Samuel Williams 0001, Nicholas J. Wright, Wahid Bhimji. Comprehensive Performance Modeling and System Design Insights for Foundation Models. In SC24-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis, Atlanta, GA, USA, November 17-22, 2024. pages 1380-1397, IEEE, 2024. [doi]

Abstract

Abstract is missing.