Online mirror descent and dual averaging: keeping pace in the dynamic case

Huang Fang, Nick Harvey, Victor S. Portella, Michael P. Friedlander

Abstract: Online mirror descent (OMD) and dual averaging (DA)—two fundamental algorithms for online convex optimization—are known to have very similar (and sometimes identical) performance guarantees when us...