Omnia: Efficient RAG Serving through Speculative Scheduling

Rongtian Fu, Shigang Li 0002, Youxuan Xu, Tong Wu 0024, Zhi Ma, Jinliang Shi. Omnia: Efficient RAG Serving through Speculative Scheduling. In Sanmukh Kuppannagari, Mehmet Koyutürk, Alfredo Goldman, Dimitrios S. Nikolopoulos, editors, Proceedings of the 35th International Symposium on High-Performance Parallel and Distributed Computing, HPDC 2026, Cleveland, OH, USA, July 13-16, 2026. pages 165-178, ACM, 2026. [doi]

Authors

Rongtian Fu

This author has not been identified. Look up 'Rongtian Fu' in Google

Shigang Li 0002

This author has not been identified. Look up 'Shigang Li 0002' in Google

Youxuan Xu

This author has not been identified. Look up 'Youxuan Xu' in Google

Tong Wu 0024

This author has not been identified. Look up 'Tong Wu 0024' in Google

Zhi Ma

This author has not been identified. Look up 'Zhi Ma' in Google

Jinliang Shi

This author has not been identified. Look up 'Jinliang Shi' in Google