AlignedServe: Orchestrating Prefix-aware Batching to Build a High-throughput and Computing-efficient LLM Serving System

Fengyao Bai, Hongbin Zhang 0006, Zhitao Chen, Jiangsu Du, Zhiguang Chen 0001, Yutong Lu. AlignedServe: Orchestrating Prefix-aware Batching to Build a High-throughput and Computing-efficient LLM Serving System. Proc. ACM Manag. Data, 4(3), 2026. [doi]

Abstract

Abstract is missing.