Multifunctional human visual pathway-replicated hardware based on 2D materials

Artificial visual system empowered by 2D materials-based hardware simulates the functionalities of the human visual system, leading the forefront of artificial intelligence vision. However, retina-mimicked hardware that has not yet fully emulated the neural circuits of visual pathways is restricted...

Full description

Saved in:
Bibliographic Details
Published inNature communications Vol. 15; no. 1; p. 8650
Main Authors Peng, Zhuiri, Tong, Lei, Shi, Wenhao, Xu, Langlang, Huang, Xinyu, Li, Zheng, Yu, Xiangxiang, Meng, Xiaohan, He, Xiao, Lv, Shengjie, Yang, Gaochen, Hao, Hao, Jiang, Tian, Miao, Xiangshui, Ye, Lei
Format Journal Article
LanguageEnglish
Published London Nature Publishing Group 01.01.2024
Subjects
Arrays
Artificial intelligence
Blindness
Circuits
Clean energy
Color blindness
Color vision
Hardware
Human-computer interface
Information processing
Machine vision
Neural networks
Retina
Robotics
Selenides
Shape recognition
Tracking
Tungsten
Tungsten compounds
Two dimensional materials
Visual cortex
Visual pathways
Visual system
Online AccessGet full text

Cover

More Information
Summary:Artificial visual system empowered by 2D materials-based hardware simulates the functionalities of the human visual system, leading the forefront of artificial intelligence vision. However, retina-mimicked hardware that has not yet fully emulated the neural circuits of visual pathways is restricted from realizing more complex and special functions. In this work, we proposed a human visual pathway-replicated hardware that consists of crossbar arrays with split floating gate 2D tungsten diselenide (WSe2) unit devices that simulate the retina and visual cortex, and related connective peripheral circuits that replicate connectomics between the retina and visual cortex. This hardware experimentally displays advanced multi-functions of red–green color-blindness processing, low-power shape recognition, and self-driven motion tracking, promoting the development of machine vision, driverless technology, brain–computer interfaces, and intelligent robotics.Realizing complex functions in artificial visual systems is challenging. Here, the authors report a human visual pathway-replicated hardware with a split floating gate crossbar arrays and related peripheral circuits, achieving colour-blindness processing, shape recognition, and self-driven motion tracking.
ISSN:2041-1723
DOI:10.1038/s41467-024-52982-3