BMInf: An Efficient Toolkit for Big Model Inference and Tuning

Xu Han, Guoyang Zeng, Weilin Zhao, Zhiyuan Liu, Zhengyan Zhang, Jie Zhou, Jun Zhang, Jia Chao, Maosong Sun

Abstract: Xu Han, Guoyang Zeng, Weilin Zhao, Zhiyuan Liu, Zhengyan Zhang, Jie Zhou, Jun Zhang, Jia Chao, Maosong Sun. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. 2022.