Xue Lin, Zhibo Zhang, Peining Yue, Haoran Li, Jin Zhang 0003, Baoyu Fan, Huayou Su, Xiaoli Gong. SyncIntellects: Orchestrating LLM Inference with Progressive Prediction and QoS-Friendly Control. In 32nd IEEE/ACM International Symposium on Quality of Service, IWQoS 2024, Guangzhou, China, June 19-21, 2024. pages 1-10, IEEE, 2024. [doi]
Abstract is missing.