Densifying Assumed-Sparse Tensors - Improving Memory Efficiency and MPI Collective Performance During Tensor Accumulation for Parallelized Training of Neural Machine Translation Models

Derya Cavdar, Valeriu Codreanu, Can Karakus, John A. Lockman III, Damian Podareanu, Vikram A. Saletore, Alexander Sergeev, Don D. Smith II, Victor Suthichai, Quy Ta, Srinivas Varadharajan, Lucas A. Wilson, Rengan Xu, Pei Yang. Densifying Assumed-Sparse Tensors - Improving Memory Efficiency and MPI Collective Performance During Tensor Accumulation for Parallelized Training of Neural Machine Translation Models. In Michèle Weiland, Guido Juckeland, Carsten Trinitis, Ponnuswamy Sadayappan, editors, High Performance Computing - 34th International Conference, ISC High Performance 2019, Frankfurt/Main, Germany, June 16-20, 2019, Proceedings. Volume 11501 of Lecture Notes in Computer Science, pages 23-39, Springer, 2019. [doi]

Authors

Derya Cavdar

This author has not been identified. Look up 'Derya Cavdar' in Google

Valeriu Codreanu

This author has not been identified. Look up 'Valeriu Codreanu' in Google

Can Karakus

This author has not been identified. Look up 'Can Karakus' in Google

John A. Lockman III

This author has not been identified. Look up 'John A. Lockman III' in Google

Damian Podareanu

This author has not been identified. Look up 'Damian Podareanu' in Google

Vikram A. Saletore

This author has not been identified. Look up 'Vikram A. Saletore' in Google

Alexander Sergeev

This author has not been identified. Look up 'Alexander Sergeev' in Google

Don D. Smith II

This author has not been identified. Look up 'Don D. Smith II' in Google

Victor Suthichai

This author has not been identified. Look up 'Victor Suthichai' in Google

Quy Ta

This author has not been identified. Look up 'Quy Ta' in Google

Srinivas Varadharajan

This author has not been identified. Look up 'Srinivas Varadharajan' in Google

Lucas A. Wilson

This author has not been identified. Look up 'Lucas A. Wilson' in Google

Rengan Xu

This author has not been identified. Look up 'Rengan Xu' in Google

Pei Yang

This author has not been identified. Look up 'Pei Yang' in Google