Gradient-based Hyperparameter Optimization through Reversible Learning

Dougal Maclaurin, David K. Duvenaud, Ryan P. Adams

Abstract: Tuning hyperparameters of learning algorithms is hard because gradients are usually unavailable. We compute exact gradients of cross-validation performance with respect to all hyperparameters by ch...