An identity for kernel ridge regression

Fedor Zhdanov, Yuri Kalnishkan

Abstract: This paper derives an identity connecting the square loss of ridge regression in on-line mode with the loss of the retrospectively best regressor. Some corollaries about the properties of the cumulative loss of on-line ridge regression are also obtained.