Neural Network-Based Dimensionality Reduction for Large-Scale Binary Optimization With Millions of Variables

Ye Tian, Luchen Wang, Shangshang Yang, Jinliang Ding, Yaochu Jin, Xingyi Zhang

Abstract: Binary optimization assumes a pervasive significance in the context of practical applications, such as knapsack problems, maximum cut problems, and critical node detection problems. Existing techniques, including mathematical programming, heuristics, evolutionary computation, and neural networks have been employed to tackle the binary optimization problems (BOPs). However, they grapple with the challenge of optimizing a large number of binary variables. In this article, we propose a dimensionality reduction method to assist the evolutionary algorithms in solving large-scale BOPs, which is achieved based on the neural networks. The proposed method converts the optimization of a large number of binary variables into the optimization of a small number of network weights, resulting in a significant reduction in search space dimensionality. Crucially, the proposed method obviates the necessity for a training process, which eliminates the requirement for a priori knowledge and enhances the search efficiency. On six types of single- and multiobjective BOPs with up to 10000000 variables, the proposed method demonstrates superiority over the top-tier evolutionary algorithms and neural network-based methods.

External IDs:dblp:journals/tec/TianWYDJZ25