Self-Supervised Speech Representation Learning: A Review

• Published in: IEEE journal of selected topics in signal processing Vol. 16; no. 6; pp. 1179 - 1210
• Main Authors: Mohamed, Abdelrahman, Lee, Hung-yi, Borgholt, Lasse, Havtorn, Jakob D., Edin, Joakim, Igel, Christian, Kirchhoff, Katrin, Li, Shang-Wen, Livescu, Karen, Maaloe, Lars, Sainath, Tara N., Watanabe, Shinji
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.10.2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Automatic speech recognition; Computer vision; Data models; Data transmission; Deep learning; Domains; Hidden Markov models; Machine learning; Modal data; Natural language processing; Regional dialects; Representation learning; Representations; Self-supervised learning; Speech; Speech processing; Speech recognition; speech representations; Training; Voice recognition
• ISSN: 1932-4553; 1941-0484
• DOI: 10.1109/JSTSP.2022.3207050

Although supervised deep learning has revolutionized speech and audio processing, it has necessitated the building of specialist models for individual tasks and application scenarios. It is likewise difficult to apply this to dialects and languages for which only limited labeled data is available. S...