Translation Tool for Alternative Communicators using Natural Language Processing

• Published in: 2024 5th International Conference on Electronics and Sustainable Communication Systems (ICESC) pp. 842 - 848
• Main Authors: Fareed, A. Irfaan, M, Ramanathan, R, Yeswanth, Devi, S.
• Format: Conference Proceeding
• Language: English
• Published: IEEE 07.08.2024
• Subjects: Auditory system; Braille; Communication systems; Computer vision; hearing impairment; machine learning; Natural language processing; Natural Language Processing (NLP); Shape; Sign language; sign language recognition; Speech processing; Technological innovation; text-to-Braille conversion; visual impairment; Visualization
• ISSN: 2996-5357
• DOI: 10.1109/ICESC60852.2024.10689941

Accessibility and integration are essential in today's world, but people with visual, hearing, and speech impairments often face significant communication barriers. Historically, creating accessible formats like Braille for the blind or transcribing sign language for the deaf has been time-consuming and bureaucratic. Individuals with disabilities have had to deal with long wait times and a heavy reliance on external resources to access information in their preferred formats. The proposed system offers a comprehensive solution by introducing a device that instantly converts various forms of input into accessible formats, bridging communication gaps between individuals with visual, auditory, and speech impairments. This device can convert typed text into Braille, audio, or text for those who are blind, deaf, or mute. It can also translate sign language gestures into text, Braille, or audio, enhancing communication. The most important innovation of the proposed system is its ability to handle multiple input and output formats. Users no longer need to navigate the bureaucracy of transcribing documents. They can enter text, speak into the device, or use sign language gestures to receive instant translations. This includes converting text to audio, sign language to text, sign language to Braille, and audio to Braille. This revolutionary process leads to greater freedom and access to information for individuals with visual, auditory, and speech impairments, promoting inclusivity and ensuring equal access to technology for all.