Lattice map spiking neural networks (LM-SNNs) for clustering and classifying image data

• Published in: Annals of mathematics and artificial intelligence Vol. 88; no. 11-12; pp. 1237 - 1260
• Main Authors: Hazan, Hananel, Saunders, Daniel J., Sanghavi, Darpan T., Siegelmann, Hava, Kozma, Robert
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.12.2020; Springer; Springer Nature B.V
• Subjects: Artificial Intelligence; Business competition; Clustering; Complex Systems; Computer Science; Image classification; Labels; Machine learning; Mathematics; Neural networks; Neurons; Self organizing maps; Spiking; Unsupervised learning; 68T99; 68T10; 68T05; 68T04; Spiking neural networks (SNN); Self clustering; Winner-take-all classification; Self-Organized Maps (SOMs); Online learning; Robostness; Unsupervised learning
• ISSN: 1012-2443; 1573-7470
• DOI: 10.1007/s10472-019-09665-3

Spiking neural networks (SNNs) with a lattice architecture are introduced in this work, combining several desirable properties of SNNs and self-organized maps (SOMs). Networks are trained with biologically motivated, unsupervised learning rules to obtain a self-organized grid of filters via cooperative and competitive excitatory-inhibitory interactions. Several inhibition strategies are developed and tested, such as (i) incrementally increasing inhibition level over the course of network training, and (ii) switching the inhibition level from low to high ( two-level ) after an initial training segment. During the labeling phase, the spiking activity generated by data with known labels is used to assign neurons to categories of data, which are then used to evaluate the network’s classification ability on a held-out set of test data. Several biologically plausible evaluation rules are proposed and compared, including a population-level confidence rating, and an n -gram inspired method. The effectiveness of the proposed self-organized learning mechanism is tested using the MNIST benchmark dataset, as well as using images produced by playing the Atari Breakout game.