Automatic fingersign-to-speech translation system

The aim of this paper is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language....

Full description

Saved in:
Bibliographic Details
Published inJournal on multimodal user interfaces Vol. 4; no. 2; pp. 61 - 79
Main Authors Hrúz, Marek, Campr, Pavel, Dikici, Erinç, Kındıroğlu, Ahmet Alp, Krňoul, Zdeněk, Ronzhin, Alexander, Sak, Haşim, Schorno, Daniel, Yalçın, Hülya, Akarun, Lale, Aran, Oya, Karpov, Alexey, Saraçlar, Murat, Železný, Milos
Format Journal Article
LanguageEnglish
Published Berlin/Heidelberg Springer-Verlag 01.07.2011
Subjects
Computer Science
Image Processing and Computer Vision
Original Paper
Signal,Image and Speech Processing
User Interfaces and Human Computer Interaction
Fingerspelling recognition
Speech synthesis
Speech recognition
Fingerspelling synthesis
Online AccessGet full text

Cover

More Information
Summary:The aim of this paper is to help the communication of two people, one hearing impaired and one visually impaired by converting speech to fingerspelling and fingerspelling to speech. Fingerspelling is a subset of sign language, and uses finger signs to spell letters of the spoken or written language. We aim to convert finger spelled words to speech and vice versa. Different spoken languages and sign languages such as English, Russian, Turkish and Czech are considered.
ISSN:1783-7677
1783-8738
DOI:10.1007/s12193-011-0059-3