Concentration bounds for two time scale stochastic approximation

Vivek S. Borkar, Sarath Pattathil

Abstract: Viewing a two time scale stochastic approximation scheme as a noisy discretization of a singularly perturbed differential equation, we obtain a concentration bound for its iterates that captures its behavior with quantifiable high probability.