PROCESSING FUNDUS CAMERA IMAGES USING MACHINE LEARNING MODELS TRAINED USING OTHER MODALITIES

• Main Authors: Webster, Dale R, Peng, Lily Hao Yi, Bavishi, Pinal, Varadarajan, Avinash Vaidyanathan
• Format: Patent
• Language: English
• Published: 18.11.2021
• Subjects: CALCULATING; COMPUTING; COUNTING; HANDLING RECORD CARRIERS; HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATIONTECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING ORPROCESSING OF MEDICAL OR HEALTHCARE DATA; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL; INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTEDFOR SPECIFIC APPLICATION FIELDS; PHYSICS; PRESENTATION OF DATA; RECOGNITION OF DATA; RECORD CARRIERS

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training a fundus image processing machine learning models that is configured to process one or more fundus images captured by a fundus camera to generate a predicted label. One of the methods includes generating training data, comprising: receiving sets of one or more training fundus images captured by a fundus camera; receiving, for each of the sets, a ground truth label assigned to a different image of the eye of the patient corresponding to the set that has been captured using a different imaging modality; and generating, for each set of training fundus images, a training example that includes the set of training fundus images in association with the ground truth label assigned to the different image of the patients eye; and training the machine learning model on the training examples in the training data.