SyncIntellects: Orchestrating LLM Inference with Progressive Prediction and QoS-Friendly Control - researchr publication authors

researchr

You are not signed in
Sign in
Sign up

Xue Lin, Zhibo Zhang, Peining Yue, Haoran Li, Jin Zhang 0003, Baoyu Fan, Huayou Su, Xiaoli Gong. SyncIntellects: Orchestrating LLM Inference with Progressive Prediction and QoS-Friendly Control. In 32nd IEEE/ACM International Symposium on Quality of Service, IWQoS 2024, Guangzhou, China, June 19-21, 2024. pages 1-10, IEEE, 2024. [doi]

This author has not been identified. Look up 'Xue Lin' in GoogleThis author has not been identified. Look up 'Zhibo Zhang' in GoogleThis author has not been identified. Look up 'Peining Yue' in GoogleThis author has not been identified. Look up 'Haoran Li' in GoogleThis author has not been identified. Look up 'Jin Zhang 0003' in GoogleThis author has not been identified. Look up 'Baoyu Fan' in GoogleThis author has not been identified. Look up 'Huayou Su' in GoogleThis author has not been identified. Look up 'Xiaoli Gong' in Google

runs on WebDSL