A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Mohammed Nowaz Rabbani Chowdhury, Meng Wang 0003, Kaoutar El Maghraoui, Naigang Wang, Pin-Yu Chen, Christopher D. Carothers. A Provably Effective Method for Pruning Experts in Fine-tuned Sparse Mixture-of-Experts. In Forty-first International Conference on Machine Learning, ICML 2024, Vienna, Austria, July 21-27, 2024. OpenReview.net, 2024. [doi]

This author has not been identified. Look up 'Mohammed Nowaz Rabbani Chowdhury' in GoogleThis author has not been identified. Look up 'Meng Wang 0003' in GoogleThis author has not been identified. Look up 'Kaoutar El Maghraoui' in GoogleThis author has not been identified. Look up 'Naigang Wang' in GoogleThis author has not been identified. Look up 'Pin-Yu Chen' in GoogleThis author has not been identified. Look up 'Christopher D. Carothers' in Google

runs on WebDSL