An AI-Based Visual Aid With Integrated Reading Assistant for the Completely Blind

• Published in: IEEE transactions on human-machine systems Vol. 50; no. 6; pp. 507 - 517
• Main Authors: Khan, Muiz Ahmed, Paul, Pias, Rashid, Mahmudur, Hossain, Mainul, Ahad, Md Atiqur Rahman
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.12.2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Assistive technology; Blind people; Blindness; Cameras; completely blind; Converters; electronic navigation aid; Eyewear; Image processing; Navigation; Object recognition; Obstacle avoidance; Performance evaluation; Raspberry Pi; Real-time systems; Sensors; visual aid; Visual aids; visually impaired people; Wearable computers; wearable system
• ISSN: 2168-2291; 2168-2305
• DOI: 10.1109/THMS.2020.3027534

Blindness prevents a person from gaining knowledge of the surrounding environment and makes unassisted navigation, object recognition, obstacle avoidance, and reading tasks a major challenge. In this work, we propose a novel visual aid system for the completely blind. Because of its low cost, compact size, and ease-of-integration, Raspberry Pi 3 Model B+ has been used to demonstrate the functionality of the proposed prototype. The design incorporates a camera and sensors for obstacle avoidance and advanced image processing algorithms for object detection. The distance between the user and the obstacle is measured by the camera as well as ultrasonic sensors. The system includes an integrated reading assistant, in the form of the image-to-text converter, followed by an auditory feedback. The entire setup is lightweight and portable and can be mounted onto a regular pair of eyeglasses, without any additional cost and complexity. Experiments are carried out with 60 completely blind individuals to evaluate the performance of the proposed device with respect to the traditional white cane. The evaluations are performed in controlled environments that mimic real-world scenarios encountered by a blind person. Results show that the proposed device, as compared with the white cane, enables greater accessibility, comfort, and ease of navigation for the visually impaired.