Yaodan Xu, Jingzhou Sun, Sheng Zhou 0001, Zhisheng Niu. SMDP-Based Dynamic Batching for Efficient Inference on GPU-Based Platforms. In IEEE International Conference on Communications, ICC 2023, Rome, Italy, May 28 - June 1, 2023. pages 5483-5489, IEEE, 2023. [doi]
Abstract is missing.