Shadow Detection and Removal from Photo-realistic Synthetic Urban Image using Deep Learning

Recently, virtual reality technology that can interact with various data is used for urban design and analysis. Reality, one of the most important elements in virtual reality technology, means visual expression so that a person can experience threedimensional space like reality. To obtain this reali...

Full description

Saved in:
Bibliographic Details
Published inComputers, materials & continua Vol. 62; no. 1; pp. 459 - 472
Main Authors Yoon, Hee-Jin, Kim, Kang-Jik, Chun, Jun-Chul
Format Journal Article
LanguageEnglish
Published Henderson Tech Science Press 2020
Subjects
Datasets
Deep learning
Image detection
Machine learning
Realism
Shadow masks
Shadows
Spatial data
Three dimensional models
Urban planning
Virtual environments
Virtual reality
Online AccessGet full text

Cover

More Information
Summary:Recently, virtual reality technology that can interact with various data is used for urban design and analysis. Reality, one of the most important elements in virtual reality technology, means visual expression so that a person can experience threedimensional space like reality. To obtain this realism, real-world data are used in the various fields. For example, in order to increase the realism of 3D modeled building textures real aerial images are utilized in 3D modelling. However, the aerial image captured during the day can be shadowed by the sun and it can cause the distortion or deterioration of image. To resolve this problem, researches on detecting and removing shadows have been conducted, but the detecting and removing shadow is still considered as a challenging problem. In this paper, we propose a novel method for detecting and removing shadows using deep learning. For this work, we first a build a new dataset of photo-realistic synthetic urban data based on the virtual environment using 3D spatial information provided by VWORLD. For detecting and removing shadow from the dataset, firstly, the 1-channel shadow mask image is inferred from the 3-channel shadow image through the CNN. Then, to generate a shadow-free image, a 3-channel shadow image and a detected 1-channel shadow mask into the GAN is executed. From the experiments, we can prove that the proposed method outperforms the existing methods in detecting and removing shadow.
ISSN:1546-2226
1546-2218
1546-2226
DOI:10.32604/cmc.2020.08799