Multiclass Coarse Analysis for UAV Imagery

• Published in: IEEE transactions on geoscience and remote sensing Vol. 53; no. 12; pp. 6394 - 6406
• Main Authors: Moranduzzo, Thomas, Melgani, Farid, Mekhalfi, Mohamed Lamine, Bazi, Yakoub, Alajlan, Naif
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.12.2015; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Coarse description; Feature extraction; histogram of gradients (HoGs); Histograms; Image color analysis; image multilabeling; Remote sensing; Satellites; scale-invariant feature transform (SIFT); Shape; similarity measures; Training; Unmanned aerial vehicles; unmanned aerial vehicles (UAVs); histogram of gradients (HoGs); similarity measures; unmanned aerial vehicles (UAVs); scale-invariant feature transform (SIFT); Coarse description; image multilabeling
• ISSN: 0196-2892; 1558-0644
• DOI: 10.1109/TGRS.2015.2438400

This paper presents a novel method to "coarsely" describe extremely high-resolution (EHR) images acquired by means of unmanned aerial vehicles (UAVs) over urban areas. Standard image analysis approaches cannot be directly exploited for the automatic description of UAV images due to their EHR. For this reason, we propose an alternative approach that consists first in the subdivision of the original UAV image in a grid of tiles. Then, each tile is compared with a library of training tiles to inherit the binary multilabel vector of the most similar training tile. This vector conveys a list of classes likely present in the considered tile. Our multiclass tile-based approach needs the definition of two main ingredients: 1) a suitable tile-representation strategy; and 2) a tile-to-tile matching operation. Various tile-representation and matching strategies are investigated. In particular, we present three global representation strategies, which process each tile as a whole and two point-based strategies that exploit points of interest within the considered tile. Regarding the matching strategies, two simple measures of distance, namely, the Euclidean and the chi-squared histogram distances, are explored. Interesting experimental results conducted on a rich set of real UAV images acquired over an urban area are reported and discussed.