An adaptive load balancing strategy for stateful join operator in skewed data stream environments

Dawei Sun, Chunlin Zhang, Shang Gao, Rajkumar Buyya

Abstract: Highlights•Developed a neural network model predicting the distribution of stream key frequency.•Proposed a key frequency aware grouping strategy and an elastic scaling algorithm.•Designed and implemented the adaptive stream join system Aj-Stream.•Evaluated the performance of Aj-Stream through extensive experiments.