Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation

Rongyu Zhang, Yulin Luo, Jiaming Liu, Huanrui Yang, Zhen Dong, Denis A. Gudovskiy, Tomoyuki Okuno, Yohei Nakata, Kurt Keutzer, Yuan Du, Shanghang Zhang. Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation. In Michael J. Wooldridge, Jennifer G. Dy, Sriraam Natarajan, editors, Thirty-Eigth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada. pages 16812-16820, AAAI Press, 2024. [doi]

@inproceedings{ZhangLLYDGONKDZ24,
  title = {Efficient Deweahter Mixture-of-Experts with Uncertainty-Aware Feature-Wise Linear Modulation},
  author = {Rongyu Zhang and Yulin Luo and Jiaming Liu and Huanrui Yang and Zhen Dong and Denis A. Gudovskiy and Tomoyuki Okuno and Yohei Nakata and Kurt Keutzer and Yuan Du and Shanghang Zhang},
  year = {2024},
  doi = {10.1609/aaai.v38i15.29622},
  url = {https://doi.org/10.1609/aaai.v38i15.29622},
  researchr = {https://researchr.org/publication/ZhangLLYDGONKDZ24},
  cites = {0},
  citedby = {0},
  pages = {16812-16820},
  booktitle = {Thirty-Eigth AAAI Conference on Artificial Intelligence, AAAI 2024, Thirty-Sixth Conference on Innovative Applications of Artificial Intelligence, IAAI 2024, Fourteenth Symposium on Educational Advances in Artificial Intelligence, EAAI 2014, February 20-27, 2024, Vancouver, Canada},
  editor = {Michael J. Wooldridge and Jennifer G. Dy and Sriraam Natarajan},
  publisher = {AAAI Press},
}