Incorporating domain knowledge into neural-guided search via in situ priors and constraintsDownload PDF

Published: 14 Jul 2021, Last Modified: 05 May 2023AutoML@ICML2021 PosterReaders: Everyone
Keywords: AutoML, reinforcement learning, symbolic regression
TL;DR: We formalize a framework for incorporating domain knowledge into neural-guided search.
Abstract: Many AutoML problems involve optimizing discrete objects under a black-box reward. Neural-guided search provides a flexible means of searching these combinatorial spaces using an autoregressive recurrent neural network. A major benefit of this approach is that builds up objects $\textit{sequentially}$—this provides an opportunity to incorporate domain knowledge into the search by directly modifying the logits emitted during sampling. In this work, we formalize a framework for incorporating such $\textit{in situ}$ priors and constraints into neural-guided search, and provide sufficient conditions for enforcing constraints. We integrate several priors and constraints from existing works into this framework, propose several new ones, and demonstrate their efficacy in informing the task of symbolic regression.
Ethics Statement: The authors do not foresee any unethical uses of the proposed methods.
Crc Pdf: pdf
Poster Pdf: pdf
Original Version: pdf
3 Replies