Exploring the Limits of Concurrency in ML Training on Google TPUS

Sameer Kumar, Yu Emma Wang, Cliff Young, James Bradbury, Naveen Kumar, Dehao Chen, Andy Swing. Exploring the Limits of Concurrency in ML Training on Google TPUS. In Alex Smola, Alex Dimakis, Ion Stoica, editors, Proceedings of Machine Learning and Systems 2021, MLSys 2021, virtual, April 5-9, 2021. mlsys.org, 2021. [doi]

@inproceedings{KumarWYBKCS21,
  title = {Exploring the Limits of Concurrency in ML Training on Google TPUS},
  author = {Sameer Kumar and Yu Emma Wang and Cliff Young and James Bradbury and Naveen Kumar and Dehao Chen and Andy Swing},
  year = {2021},
  url = {https://proceedings.mlsys.org/paper/2021/hash/28dd2c7955ce926456240b2ff0100bde-Abstract.html},
  researchr = {https://researchr.org/publication/KumarWYBKCS21},
  cites = {0},
  citedby = {0},
  booktitle = {Proceedings of Machine Learning and Systems 2021, MLSys 2021, virtual, April 5-9, 2021},
  editor = {Alex Smola and Alex Dimakis and Ion Stoica},
  publisher = {mlsys.org},
}