An Irregular Pupil Localization Network Driven by ResNet Architecture

• Published in: Mathematics (Basel) Vol. 12; no. 17; p. 2703
• Main Authors: Yang, Genjian, Chen, Wenbai, Wu, Peiliang, Gou, Jianping, Meng, Xintong
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.09.2024
• Subjects: Accuracy; Algorithms; center determination; Complexity; Deep learning; dense dilated convolutions; Efficiency; Eye movements; Image quality; Infrared imagery; Infrared imaging; Localization; Methods; Neural networks; NIR; pupil localization; ResNet; Robustness; User experience; Virtual reality
• ISSN: 2227-7390; 2227-7390
• DOI: 10.3390/math12172703

The precise and robust localization of pupils is crucial for advancing medical diagnostics and enhancing user experience. Currently, the predominant method for determining the center of the pupil relies on the principles of multi-view geometry, necessitating the simultaneous operation of multiple sensors at different angles. This study introduces a single-stage pupil localization network named ResDenseDilateNet, which is aimed at utilizing a single sensor for pupil localization and ensuring accuracy and stability across various application environments. Our network utilizes near-infrared (NIR) imaging to ensure high-quality image output, meeting the demands of most current applications. A unique technical highlight is the seamless integration of the efficient characteristics of the Deep Residual Network (ResNet) with the Dense Dilated Convolutions Merging Module (DDCM), which substantially enhances the network’s performance in precisely capturing pupil features, providing a deep and accurate understanding and extraction of pupil details. This innovative combination strategy greatly improves the system’s ability to handle the complexity and subtleties of pupil detection, as well as its adaptability to dynamic pupil changes and environmental factors. Furthermore, we have proposed an innovative loss function, the Contour Centering Loss, which is specifically designed for irregular or partially occluded pupil scenarios. This method innovatively calculates the pupil center point, significantly enhancing the accuracy of pupil localization and robustness of the model in dealing with varied pupil morphologies and partial occlusions. The technology presented in this study not only significantly improves the precision of pupil localization but also exhibits exceptional adaptability and robustness in dealing with complex scenarios, diverse pupil shapes, and occlusions, laying a solid foundation for the future development and application of pupil localization technology.