An Alternative Audio-Tactile Method of Presenting Structural Information Contained in Mathematical Drawings Adapted to the Needs of the Blind

• Published in: Applied sciences Vol. 13; no. 17; p. 9989
• Main Authors: Maćkowski, Michał, Kawulok, Mateusz, Brzoza, Piotr, Janczy, Marceli, Spinczyk, Dominik
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.09.2023
• Subjects: accessibility; Adaptation; alternative audio-tactile presentation; Analysis; assistive technologies; blind people; Blindness; Braille; Cognition & reasoning; Numerical analysis; synchronization of information; visual channel substitution; Visual impairment; Poland; Germany
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app13179989

Alternative methods of presenting the information contained in mathematical images, which are adapted to the needs of blind people, are significant challenges in modern education. This article presents an alternative multimodal method that substitutes the sense of sight with the sense of touch and hearing to convey graphical information. The developed method was evaluated at a center specializing in the education of the blind in Poland, on a group of 46 students aged 15–19. They solved a set of 60 high school-level problems on geometry, mathematical analysis, and various types of graphs. We assessed the mechanisms introduced for the sense of touch and hearing, as well as the overall impression of the users. The system usability scale and the NASA task load index tests were used in the evaluation. The results obtained indicate an overall increase in user satisfaction and usefulness of the proposed approach and a reduction in the workload during exercise solving. The results also show a significant impact of the proposed navigation modes on the average time to reach objects in the drawing. Therefore, the presented method could significantly contribute to the development of systems supporting multimodal education for people with blindness.