Yi-Syuan Ke, Zhan-Wei Wu, Chih-Tai Tsai, Sao-Hsuan Lin, Jerry Chou 0001. HybridServe: Stall-Free Distributed Disaggregated LLM Inference with Hybrid KVCache Buffering. In Valeria Cardellini, Radu Prodan, editors, Proceedings of the 16th International Conference on Cloud Computing and Services Science, CLOSER 2026, Benidorm, Spain, May 19-21, 2026. pages 285-292, SCITEPRESS, 2026. [doi]
Abstract is missing.