RetinaMatch: Efficient Template Matching of Retina Images for Teleophthalmology

• Published in: IEEE transactions on medical imaging Vol. 38; no. 8; pp. 1993 - 2004
• Main Authors: Gong, Chen, Erichson, N. Benjamin, Kelly, John P., Trutoiu, Laura, Schowengerdt, Brian T., Brunton, Steven L., Seibel, Eric J.
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.08.2019; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adapters; Algorithms; Computer simulation; Databases, Factual; Diagnostic Techniques, Ophthalmological; dimension reduction; Dimensionality reduction; Feature extraction; Field of view; health monitoring; Humans; Image acquisition; Image degradation; Image Interpretation, Computer-Assisted - methods; Image quality; Imaging; Localization; Mixed reality; mutual information; Optics; Optimization; Pixels; Principal Component Analysis; Reduction; Registration; Retina; Retina - diagnostic imaging; Retina image template matching; Retinal images; Smartphones; Telemedicine - methods; teleophthalmology; Template matching
• ISSN: 0278-0062; 1558-254X
• DOI: 10.1109/TMI.2019.2923466

Retinal template matching and registration is an important challenge in teleophthalmology with low-cost imaging devices. However, the images from such devices generally have a small field of view (FOV) and image quality degradations, making matching difficult. In this paper, we develop an efficient and accurate retinal matching technique that combines dimension reduction and mutual information (MI), called RetinaMatch. The dimension reduction initializes the MI optimization as a coarse localization process, which narrows the optimization domain and avoids local optima. The effectiveness of RetinaMatch is demonstrated on the open fundus image database STARE with simulated reduced FOV and anticipated degradations, and on retinal images acquired by adapter-based optics attached to a smartphone. RetinaMatch achieves a success rate over 94% on human retinal images with the matched target registration errors below 2 pixels on average, excluding the observer variability, outperforming standard template matching solutions. In the application of measuring vessel diameter repeatedly, single pixel errors are expected. In addition, our method can be used in the process of image mosaicking with area-based registration, providing a robust approach when feature-based methods fail. To the best of our knowledge, this is the first template matching algorithm for retina images with small template images from unconstrained retinal areas. In the context of the emerging mixed reality market, we envision automated retinal image matching and registration methods as transformative for advanced teleophthalmology and long-term retinal monitoring.