The impact of removing head movements on audio-visual speech enhancement

• Published in: arXiv.org
• Main Authors: Kang, Zhiqi, Sadeghi, Mostafa, Horaud, Radu, Alameda-Pineda, Xavier, Donley, Jacob, Kumar, Anurag
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 02.02.2022
• Subjects: Coders; Head movement; Performance degradation; Performance enhancement; Speech processing

This paper investigates the impact of head movements on audio-visual speech enhancement (AVSE). Although being a common conversational feature, head movements have been ignored by past and recent studies: they challenge today's learning-based methods as they often degrade the performance of mod...