Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism

Saar Eliad, Ido Hakimi, Alon De Jagger, Mark Silberstein, Assaf Schuster. Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism. In Irina Calciu, Geoff Kuenning, editors, 2021 USENIX Annual Technical Conference, USENIX ATC 2021, July 14-16, 2021. pages 381-396, USENIX Association, 2021. [doi]

@inproceedings{EliadHJSS21,
  title = {Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism},
  author = {Saar Eliad and Ido Hakimi and Alon De Jagger and Mark Silberstein and Assaf Schuster},
  year = {2021},
  url = {https://www.usenix.org/conference/atc21/presentation/eliad},
  researchr = {https://researchr.org/publication/EliadHJSS21},
  cites = {0},
  citedby = {0},
  pages = {381-396},
  booktitle = {2021 USENIX Annual Technical Conference, USENIX ATC 2021, July 14-16, 2021},
  editor = {Irina Calciu and Geoff Kuenning},
  publisher = {USENIX Association},
}