Mutual information measure of visual perception based on noisy spiking neural networks

• Published in: Frontiers in neuroscience Vol. 17; p. 1155362
• Main Authors: Xu, Ziheng, Zhai, Yajie, Kang, Yanmei
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 16.08.2023; Frontiers Media S.A
• Subjects: Algorithms; aperiodic stochastic resonance; Firing pattern; Information theory; low-illumination image; mutual information; Neural networks; Neurons; Neuroscience; Nonlinear systems; quantile threshold; spiking neural network; Stochasticity; Visual perception
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2023.1155362

Note that images of low-illumination are weak aperiodic signals, while mutual information can be used as an effective measure for the shared information between the input stimulus and the output response of nonlinear systems, thus it is possible to develop novel visual perception algorithm based on the principle of aperiodic stochastic resonance within the frame of information theory. To confirm this, we reveal this phenomenon using the integrate-and-fire neural networks of neurons with noisy binary random signal as input first. And then, we propose an improved visual perception algorithm with the image mutual information as assessment index. The numerical experiences show that the target image can be picked up with more easiness by the maximal mutual information than by the minimum of natural image quality evaluation (NIQE), which is one of the most frequently used indexes. Moreover, the advantage of choosing quantile as spike threshold has also been confirmed. The improvement of this research should provide large convenience for potential applications including video tracking in environments of low illumination.