Efficient optimization of loops and limits with randomized telescoping sums

Alex Beatson, Ryan P. Adams

Abstract: We consider optimization problems in which the objective requires an inner loop with many steps or is the limit of a sequence of increasingly costly approximations. Meta-learning, training recurren...