Look Who's Talking: Active Speaker Detection in the Wild

• Published in: arXiv.org
• Main Authors: You Jin Kim, Hee-Soo Heo, Choe, Soyeon, Soo-Whan Chung, Kwon, Yoohwan, Bong-Jin, Lee, Kwon, Youngki, Joon Son Chung
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 17.08.2021
• Subjects: Audio equipment; Datasets; Performance evaluation; Reference systems; Segments; Speech; Video; Visual tasks

In this work, we present a novel audio-visual dataset for active speaker detection in the wild. A speaker is considered active when his or her face is visible and the voice is audible simultaneously. Although active speaker detection is a crucial pre-processing step for many audio-visual tasks, ther...