Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism

Saar Eliad, Ido Hakimi, Alon De Jagger, Mark Silberstein, Assaf Schuster. Fine-tuning giant neural networks on commodity hardware with automatic pipeline model parallelism. In Irina Calciu, Geoff Kuenning, editors, 2021 USENIX Annual Technical Conference, USENIX ATC 2021, July 14-16, 2021. pages 381-396, USENIX Association, 2021. [doi]

Abstract

Abstract is missing.