Neuromorphic vision sensors: Principle, progress and perspectives

• Published in: Journal of semiconductors Vol. 42; no. 1; pp. 13105 - 118
• Main Authors: Liao, Fuyou, Zhou, Feichi, Chai, Yang
• Format: Journal Article
• Language: English
• Published: Department of Applied Physics, The Hong Kong Polytechnic University, Hong Kong, China%Department of Applied Physics, The Hong Kong Polytechnic University, Hong Kong, China 01.01.2021; The Hong Kong Polytechnic University Shenzhen Research Institute, Shenzhen 518057, China
• Subjects: image sensors; photonic synapses; silicon retina; neuromorphic vision sensors
• ISSN: 1674-4926; 2058-6140
• DOI: 10.1088/1674-4926/42/1/013105

Conventional frame-based image sensors suffer greatly from high energy consumption and latency. Mimicking neurobiological structures and functionalities of the retina provides a promising way to build a neuromorphic vision sensor with highly efficient image processing. In this review article, we will start with a brief introduction to explain the working mechanism and the challenges of conventional frame-based image sensors, and introduce the structure and functions of biological retina. In the main section, we will overview recent developments in neuromorphic vision sensors, including the silicon retina based on conventional Si CMOS digital technologies, and the neuromorphic vision sensors with the implementation of emerging devices. Finally, we will provide a brief outline of the prospects and outlook for the development of this field.