Memetic Evolutionary Learning for Local Unit Networks

Roman Neruda, Petra Vidnerová

Abstract: In this work we propose two hybrid algorithms combining evolutionary search with optimization algorithms. One algorithm memetically combines global evolution with gradient descent local search, while the other is a two-step procedure combining linear optimization with evolutionary search. It is shown that these algorithms typically produce smaller local unit networks with performance similar to theoretically sound but large regularization networks.