Blessings of many good arms in multi-objective linear bandits

Heesang Ann, Min-hwan Oh

Keywords: multi-objective, free exploration, linear bandit

TL;DR: We studied free exploration in multi-objective bandits when there are many good arms.

Abstract:

Multi-objective decision-making is often deemed overly complex in bandit settings, leading to algorithms that are both complicated and frequently impractical. In this paper, we challenge that notion by showing that,
under a novel *goodness of arms* condition, multiple objectives can facilitate learning, enabling simple near-greedy methods to achieve sub-linear Pareto regret.
To our knowledge, this is the first work to demonstrate the effectiveness of near-greedy algorithms for multi-objective bandits and also the first to study the regret of such algorithms for parametric bandits in the absence of context distributional assumptions.

Submission Number: 226