Head‐related transfer function–reserved time‐frequency masking for robust binaural sound source localization

• Published in: CAAI Transactions on Intelligence Technology Vol. 7; no. 1; pp. 26 - 33
• Main Authors: Liu, Hong, Yuan, Peipei, Yang, Bing, Yang, Ge, Chen, Yang
• Format: Journal Article
• Language: English
• Published: Beijing John Wiley & Sons, Inc 01.03.2022; Wiley
• Subjects: acoustic signal processing; Acoustics; Artificial neural networks; convolutional neural nets; deep learning (artificial intelligence); Direction of arrival; Ears & hearing; Fourier transforms; Localization; Masks; Neural networks; Noise; reverberation; Robustness; Sound localization; Sound sources; Speech; speech processing; Speech recognition; Task complexity; Transfer functions
• ISSN: 2468-2322; 2468-2322
• DOI: 10.1049/cit2.12010

Various time‐frequency (T‐F) masks are being applied to sound source localization tasks. Moreover, deep learning has dramatically advanced T‐F mask estimation. However, existing masks are usually designed for speech separation tasks and are suitable only for single‐channel signals. A novel complex‐valued T‐F mask is proposed that reserves the head‐related transfer function (HRTF), customized for binaural sound source localization. In addition, because the convolutional neural network that is exploited to estimate the proposed mask takes binaural spectral information as the input and output, accurate binaural cues can be preserved. Compared with conventional T‐F masks that emphasize single speech source–dominated T‐F units, HRTF‐reserved masks eliminate the speech component while keeping the direct propagation path. Thus, the estimated HRTF is capable of extracting more reliable localization features for the final direction of arrival estimation. Hence, binaural sound source localization guided by the proposed T‐F mask is robust under noisy and reverberant acoustic environments. The experimental results demonstrate that the new T‐F mask is superior to conventional T‐F masks and lead to the better performance of sound source localization in adverse environments.