Do Differentiable Simulators Give Better Policy Gradients?

Hyung Ju Suh, Max Simchowitz, Kaiqing Zhang, Russ Tedrake

Abstract: Differentiable simulators promise faster computation time for reinforcement learning by replacing zeroth-order gradient estimates of a stochastic objective with an estimate based on first-order gra...