Single Morphing Attack Detection Using Feature Selection and Visualization Based on Mutual Information

• Published in: IEEE access Vol. 9; pp. 167628 - 167641
• Main Authors: Tapia, Juan E., Busch, Christoph
• Format: Journal Article
• Language: English
• Published: Piscataway IEEE 2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Automatic control; Codes; differential morphing attack detection; Face recognition; Faces; Feature extraction; Feature selection; Histograms; Inspection; Machine learning; Morphing; Mutual information; Shape; Texture
• ISSN: 2169-3536; 2169-3536
• DOI: 10.1109/ACCESS.2021.3136485

Face morphing attack detection is a challenging task. Automatic classification methods and manual inspection are realised in automatic border control gates to detect morphing attacks. Understanding how a machine learning system can detect morphed faces and the most relevant facial areas is crucial. Those relevant areas contain texture signals that allow us to separate the bona fide and the morph images. Also, it helps in the manual examination to detect a passport generated with morphed images. This paper explores features extracted from intensity, shape, texture, and proposes a feature selection stage based on the Mutual Information filter to select the most relevant and less redundant features. This selection allows us to reduce the workload and know the exact localisation of such areas to understand the morphing impact and create a robust classifier. The best results were obtained for the method based on Conditional Mutual Information and Shape features using only 500 features for FERET images and 800 features for FRGCv2 images from 1,048 features available. The eyes and nose are identified as the most critical areas to be analysed.