Segmentation of Tree Canopies in Urban Environments Using Dilated Convolutional Neural Network

• Published in: 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS pp. 6932 - 6935
• Main Authors: Martins, Jose, Nogueira, Keiller, Zamboni, Pedro, de Oliveira, Paulo Tarso Sanches, Goncalves, Wesley Nunes, dos Santos, Jefersson A., Marcato, Jose
• Format: Conference Proceeding
• Language: English
• Published: IEEE 11.07.2021
• Subjects: Convolutional Neural Network; Deep Learning; Image segmentation; Neural networks; Remote sensing; Semantic Segmentation; Semantics; Sensors; Training; Urban areas; Urban environment; Vegetation
• ISSN: 2153-7003
• DOI: 10.1109/IGARSS47720.2021.9553218

Object detection and image segmentation are essential for environmental monitoring. This task can be performed and automated using machines with the processing capabilities of convolutional neural networks (CNN), achieving outstanding performance thanks to the current computing capacity and data available. Still, there are advances to perceive and questions on how to get the optimal performance and improve the results. With this aim, we assessed a state-of-the-art CNN, the Dynamic Dilated Convolution Neural Network (DDCN), to segment trees inside an urban environment. We chose DDCN because it exploits the paradigm of multi-context without increasing the number of trainable parameters of the network and defines, while training, the best patch size that should be used by the network in the test phase, helping to tune the CNN. With this technique, we achieved: pixel accuracy of 95.86%; average accuracy of 90.63%; F1-score of 90.93%; Kappa index of 81.87% and IoU of 72.78%. We are showing the capabilities of this CNN to segment complex images.