A high-dimensional in-sensor reservoir computing system with optoelectronic memristors for high-performance neuromorphic machine vision

• Published in: Materials horizons Vol. 11; no. 2; pp. 499 - 59
• Main Authors: Jang, Yoon Ho, Han, Joon-Kyu, Moon, Sangik, Shim, Sung Keun, Han, Janguk, Cheong, Sunwoo, Lee, Soo Hyung, Hwang, Cheol Seong
• Format: Journal Article
• Language: English
• Published: England Royal Society of Chemistry 22.01.2024
• Subjects: Electrical stimuli; Handwriting; Machine vision; Masks; Memristors; Optical communication; Optoelectronic devices; Pattern recognition; Power consumption; Sensors; Training; Vision systems; Zinc oxide
• ISSN: 2051-6347; 2051-6355
• DOI: 10.1039/d3mh01584j

In-sensor reservoir computing (RC) is a promising technology to reduce power consumption and training costs of machine vision systems by processing optical signals temporally. This study demonstrates a high-dimensional in-sensor RC system with optoelectronic memristors to enhance the performance of the in-sensor RC system. Because optoelectronic memristors can respond to both optical and electrical stimuli, optical and electrical masks are proposed to improve the dimensionality and performance of the in-sensor RC system. An optical mask is employed to regulate the wavelength of light, while an electrical mask is used to control the initial conductance of zinc oxide optoelectronic memristors. The distinct characteristics of these two masks contribute to the representation of various distinguishable reservoir states, making it possible to implement diverse reservoir configurations with minimal correlation and to increase the dimensionality of the in-sensor RC system. Using the high-dimensional in-sensor RC system, handwritten digits are successfully classified with an accuracy of 94.1%. Furthermore, human action pattern recognition is achieved with a high accuracy of 99.4%. These high accuracies are achieved with the use of a single-layer readout network, which can significantly reduce the network size and training costs. A high-dimensional in-sensor reservoir computing system with optoelectronic memristors is demonstrated utilizing optical and electrical masks. Handwritten digit classification and human action recognition are successfully achieved with high accuracy.