"GPU Scheduling"

SHEPHERD: Serving DNNs in the Wild

Model serving systems observe massive volumes of inference requests for many emerging interactive web services. These systems need to …

Hong Zhang, Yupeng Tang, Anurag Khandelwal, Ion Stoica