Multi-armed Bandit Problems with History

Pannagadatta K. Shivaswamy, Thorsten Joachims

Abstract: In this paper we consider the stochastic multi-armed bandit problem. However, unlike in the conventional version of this problem, we do not assume that the algorithm starts from scratch. Many appli...