RWKV: Reinventing RNNs for the Transformer Era

Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chung, Leon Derczynski, Xingjian Du, Matteo Grella, Kranthi Gv, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Jiaju Lin, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Guangyu Song, Xiangru Tang, Johan S. Wind, Stanislaw Wozniak, Zhenyuan Zhang, Qinghua Zhou, Jian Zhu, Rui-Jie Zhu. RWKV: Reinventing RNNs for the Transformer Era. In Houda Bouamor, Juan Pino 0001, Kalika Bali, editors, Findings of the Association for Computational Linguistics: EMNLP 2023, Singapore, December 6-10, 2023. pages 14048-14077, Association for Computational Linguistics, 2023. [doi]

Authors

Bo Peng

This author has not been identified. Look up 'Bo Peng' in Google

Eric Alcaide

This author has not been identified. Look up 'Eric Alcaide' in Google

Quentin Anthony

This author has not been identified. Look up 'Quentin Anthony' in Google

Alon Albalak

This author has not been identified. Look up 'Alon Albalak' in Google

Samuel Arcadinho

This author has not been identified. Look up 'Samuel Arcadinho' in Google

Stella Biderman

This author has not been identified. Look up 'Stella Biderman' in Google

Huanqi Cao

This author has not been identified. Look up 'Huanqi Cao' in Google

Xin Cheng

This author has not been identified. Look up 'Xin Cheng' in Google

Michael Chung

This author has not been identified. Look up 'Michael Chung' in Google

Leon Derczynski

This author has not been identified. Look up 'Leon Derczynski' in Google

Xingjian Du

This author has not been identified. Look up 'Xingjian Du' in Google

Matteo Grella

This author has not been identified. Look up 'Matteo Grella' in Google

Kranthi Gv

This author has not been identified. Look up 'Kranthi Gv' in Google

Xuzheng He

This author has not been identified. Look up 'Xuzheng He' in Google

Haowen Hou

This author has not been identified. Look up 'Haowen Hou' in Google

Przemyslaw Kazienko

This author has not been identified. Look up 'Przemyslaw Kazienko' in Google

Jan Kocon

This author has not been identified. Look up 'Jan Kocon' in Google

Jiaming Kong

This author has not been identified. Look up 'Jiaming Kong' in Google

Bartlomiej Koptyra

This author has not been identified. Look up 'Bartlomiej Koptyra' in Google

Hayden Lau

This author has not been identified. Look up 'Hayden Lau' in Google

Jiaju Lin

This author has not been identified. Look up 'Jiaju Lin' in Google

Krishna Sri Ipsit Mantri

This author has not been identified. Look up 'Krishna Sri Ipsit Mantri' in Google

Ferdinand Mom

This author has not been identified. Look up 'Ferdinand Mom' in Google

Atsushi Saito

This author has not been identified. Look up 'Atsushi Saito' in Google

Guangyu Song

This author has not been identified. Look up 'Guangyu Song' in Google

Xiangru Tang

This author has not been identified. Look up 'Xiangru Tang' in Google

Johan S. Wind

This author has not been identified. Look up 'Johan S. Wind' in Google

Stanislaw Wozniak

This author has not been identified. Look up 'Stanislaw Wozniak' in Google

Zhenyuan Zhang

This author has not been identified. Look up 'Zhenyuan Zhang' in Google

Qinghua Zhou

This author has not been identified. Look up 'Qinghua Zhou' in Google

Jian Zhu

This author has not been identified. Look up 'Jian Zhu' in Google

Rui-Jie Zhu

This author has not been identified. Look up 'Rui-Jie Zhu' in Google