DyBatch: Efficient Batching and Fair Scheduling for Deep Learning Inference on Time-sharing Devices

Shaojun Zhang, Wei Li 0058, Chen Wang 0008, Zahir Tari, Albert Y. Zomaya. DyBatch: Efficient Batching and Fair Scheduling for Deep Learning Inference on Time-sharing Devices. In 20th IEEE/ACM International Symposium on Cluster, Cloud and Internet Computing, CCGRID 2020, Melbourne, Australia, May 11-14, 2020. pages 609-618, IEEE, 2020. [doi]

Abstract

Abstract is missing.