SAR vehicle image generation with integrated deep imaging geometric information

• Published in: International journal of applied earth observation and geoinformation Vol. 132; p. 104028
• Main Authors: Sun, Xiaokun, Li, Xinwei, Xiang, Deliang, Hu, Canbin
• Format: Journal Article
• Language: English
• Published: Elsevier B.V 01.08.2024; Elsevier
• Subjects: data collection; Deep learning; Generating adversarial networks; geometry; SAR data generation; spatial data; Synthetic aperture radar; Deep learning; Generating adversarial networks; SAR data generation; Synthetic aperture radar
• ISSN: 1569-8432
• DOI: 10.1016/j.jag.2024.104028

Deep learning is widely applied in synthetic aperture radar (SAR) target recognition. However, the high cost of collecting real SAR target data leads to insufficient data volume and diversity of SAR target datasets, making it challenging to support deep learning models. Therefore, it is necessary to expand SAR target datasets through data generation. However, existing SAR target data generation methods do not fully utilize the SAR imaging geometric information of targets. This results in generating image data that does not conform to SAR physical imaging laws. To address this problem, this paper proposes a SAR vehicle data generation method that integrates deep imaging geometric information. Compared to SAR, optical data, which contains rich geometric structural information of targets, is relatively easy to collect. Therefore, the proposed method computes the dominant scattering edge (DSE) of targets under different radar incident angles with optical data. Then, based on generative adversarial networks (GAN), a SAR vehicle target data generation model is constructed. To guide the model in learning SAR imaging geometric laws of targets, the computed DSE is integrated into the generation network with multi-scale attention mechanism modules. Compared to existing SAR target data generation methods, our proposed method can generate SAR vehicle target data with distinct dominant scattering edges, and effectively addresses the issue of generated target data not conforming to SAR imaging physical laws. Metrics such as Fréchet Inception Distance (FID), scattering intensity difference, and Structural Similarity Index (SSIM) are adopted for evaluation. The SSIM between the generated and the real SAR target data reaches 0.834, the FID minimum of 96.98, and the scattering intensity difference minimum of 0.37 dB, all indicating that the SAR target data generated by the proposed method is similar to real ones in terms of deep feature, scattering intensity, and image structure. Finally, the SAR target data generated by the proposed method is verified through target recognition experiments with VGG16 and ResNet50 as backbone network. The average recognition accuracy increases by 2.80% and 2.14%, respectively. The target recognition results demonstrate that the generated SAR data can help improve target recognition accuracy, thereby validating the effectiveness of data generated by the proposed method. •Proposed a dominant scattering edges computation method using optical data of targets.•Proposed a GAN-based network structure to utilize the computed dominant scattering edges for SAR target data generation.•Effectively evaluated generated SAR target data through objective metrics and application effectiveness experiments.