Tale of Two Cs: Computation vs. Communication Scaling for Future Transformers on Future Hardware

Suchita Pati, Shaizeen Aga, Mahzabeen Islam, Nuwan Jayasena, Matthew D. Sinclair. Tale of Two Cs: Computation vs. Communication Scaling for Future Transformers on Future Hardware. In IEEE International Symposium on Workload Characterization, IISWC 2023, Ghent, Belgium, October 1-3, 2023. pages 140-153, IEEE, 2023. [doi]

Authors

Suchita Pati

This author has not been identified. Look up 'Suchita Pati' in Google

Shaizeen Aga

This author has not been identified. Look up 'Shaizeen Aga' in Google

Mahzabeen Islam

This author has not been identified. Look up 'Mahzabeen Islam' in Google

Nuwan Jayasena

This author has not been identified. Look up 'Nuwan Jayasena' in Google

Matthew D. Sinclair

This author has not been identified. Look up 'Matthew D. Sinclair' in Google