Image Generation: A Review

• Published in: Neural processing letters Vol. 54; no. 5; pp. 4609 - 4646
• Main Authors: Elasri, Mohamed, Elharrouss, Omar, Al-Maadeed, Somaya, Tairi, Hamid
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.10.2022; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Complex Systems; Computational Intelligence; Computer Science; Computer vision; Datasets; Deep learning; Image processing; Machine learning; Methods; Image-to-image translation; Text-to-image generation; Panoramic image generation; Layout-to-image generation; Sketch-to-image generation; Image generation
• ISSN: 1370-4621; 1573-773X
• DOI: 10.1007/s11063-022-10777-x

The creation of an image from another and from different types of data including text, scene graph, and object layout, is one of the very challenging tasks in computer vision. In addition, capturing images from different views for generating an object or a product can be exhaustive and expansive to do manually. Now, using deep learning and artificial intelligence techniques, the generation of new images from different type of data has become possible. For that, a significant effort has been devoted recently to develop image generation strategies with a great achievement. To that end, we present in this paper, to the best of the authors’ knowledge, the first comprehensive overview of existing image generation methods. Accordingly, a description of each image generation technique is performed based on the nature of the adopted algorithms, type of data used, and main objective. Moreover, each image generation category is discussed by presenting the proposed approaches. In addition, a presentation of existing image generation datasets is given. The evaluation metrics that are suitable for each image generation category are discussed and a comparison of the performance of existing solutions is provided to better inform the state-of-the-art and identify their limitations and strengths. Lastly, the current challenges that are facing this subject are presented.