From Importance Sampling to Doubly Robust Policy Gradient

Jiawei Huang, Nan Jiang

Abstract: We show that on-policy policy gradient (PG) and its variance reduction variants can be derived by taking finite-difference of function evaluations supplied by estimators from the importance samplin...