Balanced Off-Policy Evaluation in General Action Spaces

Arjun Sondhi, David Arbour, Drew Dimmery

Abstract: Estimation of importance sampling weights for off-policy evaluation of contextual bandits often results in imbalance—a mismatch between the desired and the actual distribution of state-action pairs...