Evolutionary Learning of Regularization Networks with Multi-kernel Units

Petra Vidnerová, Roman Neruda

Abstract: Regularization networks represent an important supervised learning method applicable for regression and classification tasks. They benefit from very good theoretical background, although the presence of meta parameters is their drawback. The meta parameters, including the type of kernel function, are typically supposed to be given in advance and come ready as an input of the algorithm. In this paper, we propose multi-kernel functions, namely product kernel functions and composite kernel functions. The choice of kernel function becomes part of the optimization process, for which a new evolutionary learning algorithm is introduced that deals with different kernel functions, including composite kernels. The results are demonstrated on experiments with benchmark tasks.