Heterogeneous Gray-Temperature Fusion-Based Deep Learning Architecture for Far Infrared Small Target Detection

• Published in: Journal of sensors Vol. 2019; no. 2019; pp. 1 - 15
• Main Authors: Ryu, Junhwan, Kim, Sungho
• Format: Journal Article
• Language: English
• Published: Cairo, Egypt Hindawi Publishing Corporation 2019; Hindawi; John Wiley & Sons, Inc
• Subjects: Approximation; Artificial intelligence; Clutter; Constant false alarm rate; Data integration; Datasets; Deep learning; Earth science; Far infrared radiation; Filter design (mathematics); Gray scale; International conferences; Machine learning; Mathematical problems; Methods; Multisensor fusion; Neural networks; Noise; Pattern recognition; Remote sensing; Studies; Target detection
• ISSN: 1687-725X; 1687-7268
• DOI: 10.1155/2019/4658068

This paper proposes the end-to-end detection of a deep network for far infrared small target detection. The problem of detecting small targets has been a subject of research for decades and has been applied mainly in the field of surveillance. Traditional methods focus on filter design for each environment, and several steps are needed to obtain the final detection result. Most of them work well in a given environment but are vulnerable to severe clutter or environmental changes. This paper proposes a novel deep learning-based far infrared small target detection method and a heterogeneous data fusion method to solve the lack of semantic information due to the small target size. Heterogeneous data consists of radiometric temperature data (14-bit) and gray scale data (8-bit), which includes the physical meaning of the target, and compares the effects of the normalization method to fuse heterogeneous data. Experiments were conducted using an infrared small target dataset built directly on the cloud backgrounds. The experimental results showed that there is a significant difference in performance according to the various fusion methods and normalization methods, and the proposed detector showed approximately 20% improvement in average precision (AP) compared to the baseline constant false alarm rate (CFAR) detector.