British Sign Language Recognition via Late Fusion of Computer Vision and Leap Motion with Transfer Learning to American Sign Language

• Published in: Sensors (Basel, Switzerland) Vol. 20; no. 18; p. 5151
• Main Authors: Bird, Jordan J., Ekárt, Anikó, Faria, Diego R.
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI 09.09.2020; MDPI AG
• Subjects: Computers; Humans; late fusion; Machine Learning; Movement; multimodality; Neural Networks, Computer; Sign Language; sign language recognition; United Kingdom; United States; United States; United Kingdom; late fusion; multimodality; sign language recognition

In this work, we show that a late fusion approach to multimodality in sign language recognition improves the overall ability of the model in comparison to the singular approaches of image classification (88.14%) and Leap Motion data classification (72.73%). With a large synchronous dataset of 18 BSL...