A Speech Preprocessing Method Based on Perceptually Optimized Envelope Processing to Increase Intelligibility in Reverberant Environments

• Published in: Applied sciences Vol. 11; no. 22; p. 10788
• Main Authors: Fallah, Ali, van de Par, Steven
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.11.2021
• Subjects: Algorithms; Background noise; Cost function; Frequency; Impulse response; Intelligibility; Masking; Methods; NELE; Noise; Optimization; reverberation; Signal processing; Speech; speech enhancement; speech intelligibility; Speech processing; Temporal variations
• ISSN: 2076-3417; 2076-3417
• DOI: 10.3390/app112210788

Speech intelligibility in public places can be degraded by the environmental noise and reverberation. In this study, a new near-end listening enhancement (NELE) approach is proposed in which using a time varying filter jointly enhances the onsets and reduces the overlap masking. For optimization, some look-ahead in clean speech and prior knowledge of room impulse response (RIR) are required. In this method, by optimizing a defined cost function, the Spectro-Temporal Envelope of reverb speech is optimized to be as close as possible to that of clean speech. In this cost function, onsets of speech are optimized with increased weight. This approach is different from overlap-masking ratio (OMR) and speech enhancement (OE) approaches (Grosse, van de Par, 2017, J. Audio Eng. Soc., Vol. 65 (1/2), pp. 31–41) that only consider previous frames in each time slot for determining the time variant filtering. The SRT measurements show that the new optimization framework enhances the speech intelligibility up to 2 dB more that OE.