Joint Decision of Anti-Spoofing and Automatic Speaker Verification by Multi-Task Learning With Contrastive Loss

• Published in: IEEE access Vol. 8; pp. 7907 - 7915
• Main Authors: Li, Jiakang, Sun, Meng, Zhang, Xiongwei, Wang, Yimin
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Anti-spoofing; Artificial neural networks; Biometrics (access control); Data mining; Deep learning; Embedding; Feature extraction; Machine learning; multi-task learning; Neural networks; Propagation losses; replay detection; speaker verification; Spoofing; Task analysis; triplet loss; Verification; Voice recognition
• DOI: 10.1109/ACCESS.2020.2964048
• ISSN: 2169-3536

Automatic speaker verification (ASV) is an emerging biometric verification technique with more and more applications. However, both verification accuracy and anti-spoofing should be considered carefully before putting ASV into practice, where anti-spoofing is also called replay detection in which voice is recorded, stored and replayed to deceive ASV systems. Cascaded decision of anti-spoofing and ASV is a straightforward solution to tackle the two issues. In this paper, joint decision of anti-spoofing and ASV was investigated in a multi-task learning framework with contrastive loss in order to improve the cascaded decision approach. A modified triplet loss was firstly constructed to supervise deep neural networks to extract embedding vectors containing information of both speaker identity and spoofing. The embedding vectors were subsequently taken as input features by back-end classifiers towards speaker and spoofing classification. The experimental results on both ASVspoof 2017 and ASVspoof 2019 showed that the proposed joint decision approach with triplet loss outperformed the corresponding baselines, a recent work on joint decision with Gaussian back-end fusion and our previous joint decision approach with cross-entropy loss.