BMInf: An Efficient Toolkit for Big Model Inference and Tuning

Xu Han 0007, Guoyang Zeng, Weilin Zhao, Zhiyuan Liu 0001, Zhengyan Zhang, Jie Zhou, Jun Zhang, Jia Chao, Maosong Sun. BMInf: An Efficient Toolkit for Big Model Inference and Tuning. In Valerio Basile, Zornitsa Kozareva, Sanja Stajner, editors, Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics, ACL 2022 - System Demonstrations, Dublin, Ireland, May 22-27, 2022. pages 224-230, Association for Computational Linguistics, 2022. [doi]

Abstract

Abstract is missing.