A comprehensive multimodal dataset for contactless lip reading and acoustic analysis

• Published in: Scientific data Vol. 10; no. 1; pp. 895 - 17
• Main Authors: Ge, Yao, Tang, Chong, Li, Haobo, Chen, Zikang, Wang, Jingyan, Li, Wenda, Cooper, Jonathan, Chetty, Kevin, Faccio, Daniele, Imran, Muhammad, Abbasi, Qammer H.
• Format: Journal Article
• Language: English
• Published: London Nature Publishing Group UK 13.12.2023; Nature Publishing Group; Nature Portfolio
• Subjects: 639/166/985; 639/166/987; 639/766/930/1032; Data Descriptor; Datasets; Humanities and Social Sciences; Lip; Lipreading; Motion detection; multidisciplinary; Remote sensing; Science; Science (multidisciplinary); Speech; Speech recognition; Voice recognition

Small-scale motion detection using non-invasive remote sensing techniques has recently garnered significant interest in the field of speech recognition. Our dataset paper aims to facilitate the enhancement and restoration of speech information from diverse data sources for speakers. In this paper, w...