Divide-and-conquer checkpointing for arbitrary programs with no user annotation

Jeffrey Mark Siskind, Barak A. Pearlmutter

Abstract: Classical reverse-mode automatic differentiation (AD) imposes only a small constant-factor overhead in operation count over the original computation, but has storage requirements that grow, in the ...