Accuracy exponentiation in UCS and its effect on voting margins

Tim Kovacs, Narayanan Unny Edakunni, Gavin Brown

Abstract: UCS is a Learning Classifier System (LCS) which evolves condition-action rules for supervised classification tasks. In UCS the fitness of a rule is based on its accuracy raised to a power ν, and this fitness is used in both the search for good rules (via a genetic algorithm) and in a classification vote. We trace the origin of the UCS fitness function through three successive versions of the XCS accuracy function, for which we present previously unpublished details and rationales. Through numerical examples and empirical studies we demonstrate that ν tunes both selective pressure in genetic search and the voting margin in classification, and demonstrate that ν (or some alternative) is necessary for both. We appeal to margin theory to explain the effect on classification and so connect the LCS field with ensemble systems, and we suggest ν might be useful as a noise-correction parameter. We argue that the design of fitness functions has always been the central difficulty for Michigan LCSs and that better understanding can help both parameterisation of existing algorithms and development of new ones.