HOUND: High-Order Universal Numerical Differentiator for a Parameter-free Polynomial Online Approximation
Keywords: numerical differentiation, polynomial approximation, parameter-free learning, online learning
TL;DR: automatic convergence to coefficient values of approximating polynomial through online high-order numerical differentiation
Abstract: This paper introduces a scalar numerical differentiator, represented as a system of nonlinear differential equations of any high order. We derive the explicit solution for this system and demonstrate that, with a suitable choice of differentiator order, the error converges to zero for polynomial signals with additive white noise. In more general signal cases, the error remains bounded, provided that the highest estimated derivative is also bounded. A notable advantage of this numerical differentiation method is that it does not require knowledge of the Lipschitz constant value and does not require tuning parameters based on the specific characteristics of the signal being differentiated. We propose a discretization method for the equations that implements a cumulative smoothing algorithm for time series. This algorithm operates online, without the need for data accumulation, and it solves both interpolation and extrapolation problems without fitting any coefficients to the data.
Submission Number: 5
Loading