TalkNCE: Improving Active Speaker Detection with Talk-Aware Contrastive Learning

• Published in: arXiv.org
• Main Authors: Jung, Chaeyoung, Lee, Suyeon, Nam, Kihyun, Rho, Kyeongha, You Jin Kim, Jang, Youngjoon, Joon Son Chung
• Format: Paper
• Language: English
• Published: Ithaca Cornell University Library, arXiv.org 21.09.2023
• Subjects: Computer architecture; Learning; Representations; Training

The goal of this work is Active Speaker Detection (ASD), a task to determine whether a person is speaking or not in a series of video frames. Previous works have dealt with the task by exploring network architectures while learning effective representations has been less explored. In this work, we p...