Wei Zhang 0044, Zhiyu Wu, Yi Mu 0005, Rui Ning, Banruo Liu, Nikhil Sarda, Myungjin Lee, Fan Lai 0001. JITServe: SLO-aware LLM Serving with Imprecise Request Information. In Srikanth Kandula, Hakim Weatherspoon, editors, 23rd USENIX Symposium on Networked Systems Design and Implementation, NSDI 2026, Renton, WA, May 4-6, 2026. pages 825-848, USENIX Association, 2026. [doi]
Abstract is missing.