A distributed evolutionary based instance selection algorithm for big data using Apache Spark

Liyang Qin, Xiaoli Wang, Linzi Yin, Zhaohui Jiang

Abstract: Highlights•We proposed a distributed coarse granularity chromosome structure to reduce search space and ensure load balance.•We proposed a stratified evolution strategy to transform multi-objective to multiple single-objective tasks.•We proposed a sampling-based fitness function with less time complexity