Enhancing ASR for Stuttered Speech with Limited Data Using Detect and Pass
It is estimated that around 70 million people worldwide are affected by a speech disorder called stuttering. With recent advances in Automatic Speech Recognition (ASR), voice assistants are increasingly useful in our everyday lives. Many technologies in education, retail, telecommunication and healt...
Saved in:
Main Authors | , , |
---|---|
Format | Journal Article |
Language | English |
Published |
08.02.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | It is estimated that around 70 million people worldwide are affected by a
speech disorder called stuttering. With recent advances in Automatic Speech
Recognition (ASR), voice assistants are increasingly useful in our everyday
lives. Many technologies in education, retail, telecommunication and healthcare
can now be operated through voice. Unfortunately, these benefits are not
accessible for People Who Stutter (PWS). We propose a simple but effective
method called 'Detect and Pass' to make modern ASR systems accessible for
People Who Stutter in a limited data setting. The algorithm uses a context
aware classifier trained on a limited amount of data, to detect acoustic frames
that contain stutter. To improve robustness on stuttered speech, this extra
information is passed on to the ASR model to be utilized during inference. Our
experiments show a reduction of 12.18% to 71.24% in Word Error Rate (WER)
across various state of the art ASR systems. Upon varying the threshold of the
associated posterior probability of stutter for each stacked frame used in
determining low frame rate (LFR) acoustic features, we were able to determine
an optimal setting that reduced the WER by 23.93% to 71.67% across different
ASR systems. |
---|---|
DOI: | 10.48550/arxiv.2202.05396 |