Tale of Two Cs: Computation vs. Communication Scaling for Future Transformers on Future Hardware

Suchita Pati, Shaizeen Aga, Mahzabeen Islam, Nuwan Jayasena, Matthew D. Sinclair. Tale of Two Cs: Computation vs. Communication Scaling for Future Transformers on Future Hardware. In IEEE International Symposium on Workload Characterization, IISWC 2023, Ghent, Belgium, October 1-3, 2023. pages 140-153, IEEE, 2023. [doi]

@inproceedings{PatiAIJS23,
  title = {Tale of Two Cs: Computation vs. Communication Scaling for Future Transformers on Future Hardware},
  author = {Suchita Pati and Shaizeen Aga and Mahzabeen Islam and Nuwan Jayasena and Matthew D. Sinclair},
  year = {2023},
  doi = {10.1109/IISWC59245.2023.00026},
  url = {https://doi.org/10.1109/IISWC59245.2023.00026},
  researchr = {https://researchr.org/publication/PatiAIJS23},
  cites = {0},
  citedby = {0},
  pages = {140-153},
  booktitle = {IEEE International Symposium on Workload Characterization, IISWC 2023, Ghent, Belgium, October 1-3, 2023},
  publisher = {IEEE},
  isbn = {979-8-3503-0317-9},
}