At Stability's Edge: How to Adjust Hyperparameters to Preserve Minima Selection in Asynchronous Training of Neural Networks?

Niv Giladi, Mor Shpigel Nacson, Elad Hoffer, Daniel Soudry. At Stability's Edge: How to Adjust Hyperparameters to Preserve Minima Selection in Asynchronous Training of Neural Networks?. In 8th International Conference on Learning Representations, ICLR 2020, Addis Ababa, Ethiopia, April 26-30, 2020. OpenReview.net, 2020. [doi]

Authors

Niv Giladi

This author has not been identified. Look up 'Niv Giladi' in Google

Mor Shpigel Nacson

This author has not been identified. Look up 'Mor Shpigel Nacson' in Google

Elad Hoffer

This author has not been identified. Look up 'Elad Hoffer' in Google

Daniel Soudry

This author has not been identified. Look up 'Daniel Soudry' in Google