Orchestrating scheduling, grouping and parallelism to enhance the performance of distributed stream computing system

Dawei Sun, Haiyang Chen, Shang Gao, Rajkumar Buyya

Abstract: Highlights•Experiments show single-level factor are insufficient for optimal system performance.•Establishment the DAG, data stream and resource model from quantitative perspective.•Grouping, scheduling and elastic scaling are coordinated optimization strategies.•Implementation of the prototype Sgp-Stream and its performance evaluation.