Tracking Most Significant Arm Switches in Bandits

Joe Suk, Samory Kpotufe

Abstract: In \emph{bandit with distribution shifts}, one aims to automatically adapt to unknown changes in reward distribution, and \emph{restart} exploration when necessary. While this problem has been stud...