Efficient estimation and model generalization for the totalvariability model

• Published in: Computer speech & language Vol. 53; pp. 43 - 64
• Main Authors: Travadi, Ruchir, Narayanan, Shrikanth
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.01.2019
• Subjects: i-vector; Language identification; Speaker identification; Total variability model; i-vector; Speaker identification; Language identification; Total variability model
• ISSN: 0885-2308; 1095-8363
• DOI: 10.1016/j.csl.2018.07.003

A number of audio signal processing applications characterize different properties of the source underlying an audio signal by analyzing the distribution of a sequence of feature vectors obtained from the signal. The Total Variability Model has been widely used for this purpose as a mechanism for capturing the variability in the feature vector distribution across different signals within a low dimensional representation. In order to arrive at a compact representation, a number of assumptions are made within the model regarding the properties of this distribution. In this paper, we first present an analysis of a parameter estimation method for the model which offers a computationally efficient alternative to the widely used Expectation Maximization (EM) algorithm, but relies on the validity of the model assumptions, using experiments on speaker and language identification tasks. To explain some of the results obtained using this method, we present an extensive statistical analysis aimed at verifying the validity of some of the model assumptions. We show that many of these model assumptions are not valid for the observed data, and propose model generalizations to replace these assumptions. The proposed generalizations lead to a better performance while also opening up possibilities for discriminative training of the model.