Nyström Method for Accurate and Scalable Implicit Differentiation

Ryuichiro Hataya, Makoto Yamada

Abstract: The essential difficulty of gradient-based bilevel optimization using implicit differentiation is to estimate the inverse Hessian vector product with respect to neural network parameters. This pape...