Interlocking Backpropagation: Improving depthwise model-parallelism

Aidan N. Gomez, Oscar Key, Kuba Perlin, Stephen Gou, Nick Frosst, Jeff Dean, Yarin Gal. Interlocking Backpropagation: Improving depthwise model-parallelism. Journal of Machine Learning Research, 23, 2022. [doi]

Abstract

Abstract is missing.