Adversarial Learning Based Node-Edge Graph Attention Networks for Autism Spectrum Disorder Identification

• Published in: IEEE transaction on neural networks and learning systems Vol. 35; no. 6; pp. 7275 - 7286
• Main Authors: Chen, Yuzhong, Yan, Jiadong, Jiang, Mingxin, Zhang, Tuo, Zhao, Zhongbo, Zhao, Weihua, Zheng, Jian, Yao, Dezhong, Zhang, Rong, Kendrick, Keith M., Jiang, Xi
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.06.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adversarial learning; Algorithms; Autism; autism spectrum disorder (ASD); Autism Spectrum Disorder - diagnostic imaging; Brain; Brain - diagnostic imaging; Brain modeling; Classification; Data exchange; Data models; Embedding; Functional magnetic resonance imaging; graph attention network (GAT); Graph neural networks; Heterogeneity; Humans; Image Processing, Computer-Assisted - methods; Machine Learning; Magnetic resonance; Magnetic resonance imaging; Magnetic Resonance Imaging - methods; Medical imaging; model generalizability and interpretability; multimodal magnetic resonance imaging (MRI); Neural networks; Neural Networks, Computer; Neuroimaging; Nodes; Solid modeling; Structure-function relationships
• ISSN: 2162-237X; 2162-2388; 2162-2388
• DOI: 10.1109/TNNLS.2022.3154755

Graph neural networks (GNNs) have received increasing interest in the medical imaging field given their powerful graph embedding ability to characterize the non-Euclidean structure of brain networks based on magnetic resonance imaging (MRI) data. However, previous studies are largely node-centralized and ignore edge features for graph classification tasks, resulting in moderate performance of graph classification accuracy. Moreover, the generalizability of GNN model is still far from satisfactory in brain disorder [e.g., autism spectrum disorder (ASD)] identification due to considerable individual differences in symptoms among patients as well as data heterogeneity among different sites. In order to address the above limitations, this study proposes a novel adversarial learning-based node-edge graph attention network (AL-NEGAT) for ASD identification based on multimodal MRI data. First, both node and edge features are modeled based on structural and functional MRI data to leverage complementary brain information and preserved in the constructed weighted adjacent matrix for individuals through the attention mechanism in the proposed NEGAT. Second, two AL methods are employed to improve the generalizability of NEGAT. Finally, a gradient-based saliency map strategy is utilized for model interpretation to identify important brain regions and connections contributing to the classification. Experimental results based on the public Autism Brain Imaging Data Exchange I (ABIDE I) data demonstrate that the proposed framework achieves a classification accuracy of 74.7% between ASD and typical developing (TD) groups based on 1007 subjects across 17 different sites and outperforms the state-of-the-art methods, indicating satisfying classification ability and generalizability of the proposed AL-NEGAT model. Our work provides a powerful tool for brain disorder identification.