Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithms

Ashok Vardhan Makkuva, Pramod Viswanath, Sreeram Kannan, Sewoong Oh. Breaking the gridlock in Mixture-of-Experts: Consistent and Efficient Algorithms. In Kamalika Chaudhuri, Ruslan Salakhutdinov, editors, Proceedings of the 36th International Conference on Machine Learning, ICML 2019, 9-15 June 2019, Long Beach, California, USA. Volume 97 of Proceedings of Machine Learning Research, pages 4304-4313, PMLR, 2019. [doi]

Abstract

Abstract is missing.