Evaluation and analysis of a face and voice outdoor multi-biometric system

• Published in: Pattern recognition letters Vol. 28; no. 12; pp. 1572 - 1580
• Main Authors: Vajaria, H., Islam, T., Mohanty, P., Sarkar, S., Sankar, R., Kasturi, R.
• Format: Journal Article
• Language: English
• Published: Amsterdam Elsevier B.V 01.09.2007; Elsevier
• Subjects: Applied sciences; Exact sciences and technology; Face recognition; Image processing; Information, signal and communications theory; Multi-modal fusion; Outdoor biometric database; Pattern recognition; Signal processing; Telecommunications and information theory; Voice recognition; Voice recognition; Multi-modal fusion; Face recognition; Outdoor biometric database; Biometrics; Performance evaluation; Image processing; Maximin problem; Outdoor installation; Pattern recognition; Degradation; Indoor installation; Minimax method; Database; Automatic recognition
• ISSN: 0167-8655; 1872-7344
• DOI: 10.1016/j.patrec.2007.03.019

A biometric sample collected in an uncontrolled outdoor environment varies significantly from its indoor version. Sample variations due to outdoor environmental conditions degrade the performance of biometric systems that otherwise perform well with indoor samples. In this study, we quantitatively evaluate such performance degradation in the case of a face and a voice biometric system. We also investigate how elementary combination schemes involving min–max or z normalization followed by the sum or max fusion rule can improve performance of the multi-biometric system. We use commercial biometric systems to collect face and voice samples from the same subjects in an environment that closely mimics the operational scenario. This realistic evaluation on a dataset of 116 subjects shows that the system performance degrades in outdoor scenarios but by multi-modal score fusion the performance is enhanced by 20%. We also find that max rule fusion performs better than sum rule fusion on this dataset. More interestingly, we see that by using multiple samples of the same biometric modality, the performance of a unimodal system can approach that of a multi-modal system.