Efficient Variance Reduction for Meta-learning

Hansi Yang, James T. Kwok

Abstract: Meta-learning tries to learn meta-knowledge from a large number of tasks. However, the stochastic meta-gradient can have large variance due to data sampling (from each task) and task sampling (from...