AOSLO-net: A Deep Learning-Based Method for Automatic Segmentation of Retinal Microaneurysms From Adaptive Optics Scanning Laser Ophthalmoscopy Images

• Published in: Translational vision science & technology Vol. 11; no. 8; p. 7
• Main Authors: Zhang, Qian, Sampani, Konstantina, Xu, Mengjia, Cai, Shengze, Deng, Yixiang, Li, He, Sun, Jennifer K., Karniadakis, George Em
• Format: Journal Article
• Language: English
• Published: United States The Association for Research in Vision and Ophthalmology 01.08.2022
• Subjects: Artificial Intelligence; Deep Learning; Diabetic Retinopathy - diagnostic imaging; Humans; Lasers; Microaneurysm - diagnostic imaging; Ophthalmoscopy - methods; Optics and Photonics
• ISSN: 2164-2591; 2164-2591
• DOI: 10.1167/tvst.11.8.7

Accurate segmentation of microaneurysms (MAs) from adaptive optics scanning laser ophthalmoscopy (AOSLO) images is crucial for identifying MA morphologies and assessing the hemodynamics inside the MAs. Herein, we introduce AOSLO-net to perform automatic MA segmentation from AOSLO images of diabetic retinas. AOSLO-net is composed of a deep neural network based on UNet with a pretrained EfficientNet as the encoder. We have designed customized preprocessing and postprocessing policies for AOSLO images, including generation of multichannel images, de-noising, contrast enhancement, ensemble and union of model predictions, to optimize the MA segmentation. AOSLO-net is trained and tested using 87 MAs imaged from 28 eyes of 20 subjects with varying severity of diabetic retinopathy (DR), which is the largest available AOSLO dataset for MA detection. To avoid the overfitting in the model training process, we augment the training data by flipping, rotating, scaling the original image to increase the diversity of data available for model training. The validity of the model is demonstrated by the good agreement between the predictions of AOSLO-net and the MA masks generated by ophthalmologists and skillful trainees on 87 patient-specific MA images. Our results show that AOSLO-net outperforms the state-of-the-art segmentation model (nnUNet) both in accuracy (e.g., intersection over union and Dice scores), as well as computational cost. We demonstrate that AOSLO-net provides high-quality of MA segmentation from AOSLO images that enables correct MA morphological classification. As the first attempt to automatically segment retinal MAs from AOSLO images, AOSLO-net could facilitate the pathological study of DR and help ophthalmologists make disease prognoses.