Neural Combinatorial Optimization with Reinforcement LearningDownload PDF

20 Mar 2023, 20:17 (modified: 21 Jul 2022, 19:51)Submitted to ICLR 2017Readers: Everyone
TL;DR: neural combinatorial optimization, reinforcement learning
Abstract: We present a framework to tackle combinatorial optimization problems using neural networks and reinforcement learning. We focus on the traveling salesman problem (TSP) and train a recurrent neural network that, given a set of city \mbox{coordinates}, predicts a distribution over different city permutations. Using negative tour length as the reward signal, we optimize the parameters of the recurrent neural network using a policy gradient method. Without much engineering and heuristic designing, Neural Combinatorial Optimization achieves close to optimal results on 2D Euclidean graphs with up to $100$ nodes. These results, albeit still quite far from state-of-the-art, give insights into how neural networks can be used as a general tool for tackling combinatorial optimization problems.
3 Replies