"Now I Understand": an application to bridge the gap in communication with hearing impaired people

"Now I Understand" is a mobile application that enables bilateral communication between hearing and non-hearing people using artificial intelligence techniques. The application uses deep learning models to recognize sign language and translate it into text in real-time, while also translat...

Full description

Saved in:
Bibliographic Details
Published in2023 IEEE Global Humanitarian Technology Conference (GHTC) pp. 278 - 281
Main Authors Baz, Karen, Grille, Juan Pedro, Mayr, Cristina, Gretter, Gustavo
Format Conference Proceeding
LanguageEnglish
Published IEEE 12.10.2023
Subjects
artificial intelligence
Assistive technologies
Auditory system
bilateral communication
Deep learning
Gesture recognition
mobile application
non-hearing
sign language
Text recognition
Training
User interfaces
Online AccessGet full text

Cover

More Information
Summary:"Now I Understand" is a mobile application that enables bilateral communication between hearing and non-hearing people using artificial intelligence techniques. The application uses deep learning models to recognize sign language and translate it into text in real-time, while also translating text into sign language. The details of the application implementation are discussed, including data acquisition and preprocessing, selection and training of deep learning models, and the user interface. This application has the potential to revolutionize communication and accessibility for people with hearing impairments by providing a reliable and accurate tool for bilateral communication, as well as improving the general public's awareness and understanding of sign language.
ISSN:2473-5728
DOI:10.1109/GHTC56179.2023.10354884