Improved Regret Bounds for Tracking Experts with MemoryDownload PDF

21 May 2021, 20:50 (edited 15 Jan 2022)NeurIPS 2021 PosterReaders: Everyone
  • Keywords: online learning, prediction with expert advice
  • TL;DR: We give an efficient projection-based algorithm for switching with memory in the experts setting and prove the best known regret bound.
  • Abstract: We address the problem of sequential prediction with expert advice in a non-stationary environment with long-term memory guarantees in the sense of Bousquet and Warmuth [4]. We give a linear-time algorithm that improves on the best known regret bound [27]. This algorithm incorporates a relative entropy projection step. This projection is advantageous over previous weight-sharing approaches in that weight updates may come with implicit costs as in for example portfolio optimization. We give an algorithm to compute this projection step in linear time, which may be of independent interest.
  • Supplementary Material: pdf
  • Code Of Conduct: I certify that all co-authors of this work have read and commit to adhering to the NeurIPS Statement on Ethics, Fairness, Inclusivity, and Code of Conduct.
14 Replies

Loading