A Two-Stage GAN for High-Resolution Retinal Image Generation and Segmentation

• Published in: Electronics (Basel) Vol. 11; no. 1; p. 60
• Main Authors: Andreini, Paolo, Ciano, Giorgio, Bonechi, Simone, Graziani, Caterina, Lachi, Veronica, Mecocci, Alessandro, Sodi, Andrea, Scarselli, Franco, Bianchini, Monica
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.01.2022
• Subjects: Algorithms; Blood vessels; Datasets; Diabetic retinopathy; Generative adversarial networks; High resolution; Image processing; Image quality; Image resolution; Image segmentation; Machine learning; Random variables; Retinal images; Semantics; Training
• ISSN: 2079-9292; 2079-9292
• DOI: 10.3390/electronics11010060

In this paper, we use Generative Adversarial Networks (GANs) to synthesize high-quality retinal images along with the corresponding semantic label-maps, instead of real images during training of a segmentation network. Different from other previous proposals, we employ a two-step approach: first, a progressively growing GAN is trained to generate the semantic label-maps, which describes the blood vessel structure (i.e., the vasculature); second, an image-to-image translation approach is used to obtain realistic retinal images from the generated vasculature. The adoption of a two-stage process simplifies the generation task, so that the network training requires fewer images with consequent lower memory usage. Moreover, learning is effective, and with only a handful of training samples, our approach generates realistic high-resolution images, which can be successfully used to enlarge small available datasets. Comparable results were obtained by employing only synthetic images in place of real data during training. The practical viability of the proposed approach was demonstrated on two well-established benchmark sets for retinal vessel segmentation—both containing a very small number of training samples—obtaining better performance with respect to state-of-the-art techniques.