Fast Bellman Updates for Robust MDPs

Chin Pang Ho, Marek Petrik, Wolfram Wiesemann

Abstract: We describe two efficient, and exact, algorithms for computing Bellman updates in robust Markov decision processes (MDPs). The first algorithm uses a homotopy continuation method to compute updates...