An audiovisual cognitive optimization strategy guided by salient object ranking for intelligent visual prothesis systems

• Published in: Journal of neural engineering Vol. 21; no. 6; pp. 66021 - 66041
• Main Authors: Liang, Junling, Li, Heng, Chai, Xinyu, Gao, Qi, Zhou, Meixuan, Guo, Tianruo, Chen, Yao, Di, Liqing
• Format: Journal Article
• Language: English
• Published: England IOP Publishing 01.12.2024
• Subjects: Adult; Algorithms; Artificial Intelligence; Attention - physiology; audiovisual cognition for prosthetic vision; Auditory Perception - physiology; Cognition - physiology; Deep Learning; Depth Perception - physiology; Female; Humans; image semantic description; intelligent visual prosthesis; Male; Photic Stimulation - methods; prior knowledge; Prosthesis Design - methods; salient object ranking; Visual Perception - physiology; Visual Prosthesis; image semantic description; intelligent visual prosthesis; audiovisual cognition for prosthetic vision; salient object ranking; prior knowledge

Objective. Visual prostheses are effective tools for restoring vision, yet real-world complexities pose ongoing challenges. The progress in AI has led to the emergence of the concept of intelligent visual prosthetics with auditory support, leveraging deep learning to create practical artificial visi...