TERMS: Task management policies to achieve high performance for mixed workloads using surplus resources

Jinyu Yu, Wei Tong, Pengze Lv, Dan Feng

Abstract: Highlights•Place latency-sensitive new tasks in the queue according to task relevance.•Select batch tasks to provision resources for latency-sensitive new tasks.•Select batch tasks to provision resources for latency-sensitive straggler tasks.•Ensure task fairness when tasks are preempted or resumed.•Choose befitting target nodes for latency-sensitive straggler task migration.