Sparse MoEs meet Efficient Ensembles

James Urquhart Allingham, Florian Wenzel, Zelda E. Mariet, Basil Mustafa, Joan Puigcerver, Neil Houlsby, Ghassen Jerfel, Vincent Fortuin, Balaji Lakshminarayanan, Jasper Snoek, Dustin Tran, Carlos Riquelme Ruiz, Rodolphe Jenatton. Sparse MoEs meet Efficient Ensembles. Trans. Mach. Learn. Res., 2022, 2022. [doi]

Authors

James Urquhart Allingham

This author has not been identified. Look up 'James Urquhart Allingham' in Google

Florian Wenzel

This author has not been identified. Look up 'Florian Wenzel' in Google

Zelda E. Mariet

This author has not been identified. Look up 'Zelda E. Mariet' in Google

Basil Mustafa

This author has not been identified. Look up 'Basil Mustafa' in Google

Joan Puigcerver

This author has not been identified. Look up 'Joan Puigcerver' in Google

Neil Houlsby

This author has not been identified. Look up 'Neil Houlsby' in Google

Ghassen Jerfel

This author has not been identified. Look up 'Ghassen Jerfel' in Google

Vincent Fortuin

This author has not been identified. Look up 'Vincent Fortuin' in Google

Balaji Lakshminarayanan

This author has not been identified. Look up 'Balaji Lakshminarayanan' in Google

Jasper Snoek

This author has not been identified. Look up 'Jasper Snoek' in Google

Dustin Tran

This author has not been identified. Look up 'Dustin Tran' in Google

Carlos Riquelme Ruiz

This author has not been identified. Look up 'Carlos Riquelme Ruiz' in Google

Rodolphe Jenatton

This author has not been identified. Look up 'Rodolphe Jenatton' in Google