Pattern recognition of labeled concepts by a single spiking neuron model.

Hannes Rapp, Martin Paul Nawrot, Merav Stern

Abstract:

Making an informed, correct and quick decision can be life-saving. It's crucial for animals during an escape behaviour or for autonomous cars during driving. The decision can be complex and may involve an assessment of the amount of threats present and the nature of each threat. Thus, we should expect early sensory processing to supply classification information fast and accurately, even before relying the information to higher brain areas or more complex system components downstream. Today, advanced convolution artificial neural networks can successfully solve such tasks and are commonly used to build complex decision making systems. However, in order to achieve excellent performance on these tasks they require increasingly complex, "very deep" model structure, which is costly in inference run-time, energy consumption and number of training samples, only trainable on cloud-computing clusters.
A single spiking neuron has been shown to be able to solve many of these required tasks for homogeneous Poisson input statistics, a commonly used model for spiking activity in the neocortex; when modeled as leaky integrate and fire with gradient decent learning algorithm it was shown to posses a wide variety of complex computational capabilities. Here we refine its learning algorithm. The refined gradient-based local learning rule allows for better and stable generalization. We take advantage of this improvement to solve a problem of multiple instance learning (MIL) with counting where labels are only available for collections of concepts. We use an MNIST task to show that the neuron indeed exploits the improvements and performs on par with conventional ConvNet architecture with similar parameter space size and number of training epochs.

Keywords: spiking neural networks, neual plasticity, pattern recognition, single neuron, classification