Offline Reinforcement Learning: Fundamental Barriers for Value Function Approximation

Dylan J. Foster, Akshay Krishnamurthy, David Simchi-Levi, Yunzong Xu

Abstract: We consider the offline reinforcement learning problem, where the aim is to learn a decision making policy from logged data. Offline RL—particularly when coupled with (value) function approximation...