Exploring the Benefits of Training Expert Language Models over Instruction Tuning

Joel Jang, Seungone Kim, Seonghyeon Ye, Doyoung Kim, Lajanugen Logeswaran, Moontae Lee, Kyungjae Lee, Minjoon Seo. Exploring the Benefits of Training Expert Language Models over Instruction Tuning. In Andreas Krause 0001, Emma Brunskill, KyungHyun Cho, Barbara Engelhardt, Sivan Sabato, Jonathan Scarlett, editors, International Conference on Machine Learning, ICML 2023, 23-29 July 2023, Honolulu, Hawaii, USA. Volume 202 of Proceedings of Machine Learning Research, pages 14702-14729, PMLR, 2023. [doi]

Authors

Joel Jang

This author has not been identified. Look up 'Joel Jang' in Google

Seungone Kim

This author has not been identified. Look up 'Seungone Kim' in Google

Seonghyeon Ye

This author has not been identified. Look up 'Seonghyeon Ye' in Google

Doyoung Kim

This author has not been identified. Look up 'Doyoung Kim' in Google

Lajanugen Logeswaran

This author has not been identified. Look up 'Lajanugen Logeswaran' in Google

Moontae Lee

This author has not been identified. Look up 'Moontae Lee' in Google

Kyungjae Lee

This author has not been identified. Look up 'Kyungjae Lee' in Google

Minjoon Seo

This author has not been identified. Look up 'Minjoon Seo' in Google