Brain network evaluation by functional-guided effective connectivity reinforcement learning method indicates therapeutic effect for tinnitus

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 32; p. 1
• Main Authors: Lv, Han, Liu, Jinduo, Chen, Qian, Ji, Junzhong, Zhai, Jihao, Zhang, Zuozhen, Wang, Zhaodi, Gong, Shusheng, Wang, Zhenchang
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.01.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Bayes Theorem; Bayesian analysis; Biological effects; Brain; Brain - diagnostic imaging; Brain mapping; Brain Mapping - methods; brain network; Coders; Cortex (auditory); Data acquisition; fMRI; Functional magnetic resonance imaging; Humans; Immunoglobulins; Learning; Long short-term memory; Magnetic resonance imaging; Magnetic Resonance Imaging - methods; Neural networks; Neuroimaging; Occipital lobe; Prospective Studies; Reinforcement; reinforcement learning; Retrospective Studies; Somatosensory cortex; sound therapy; Statistical inference; Therapy; Tinnitus; Tinnitus - therapy
• ISSN: 1534-4320; 1558-0210
• DOI: 10.1109/TNSRE.2024.3373335

Using functional connectivity (FC) or effective connectivity (EC) alone cannot effectively delineate brain networks based on functional magnetic resonance imaging (fMRI) data, limiting the understanding of the mechanism of tinnitus and its treatment. Investigating brain FC is a foundational step in exploring EC. This study proposed a functionally guided EC (FGEC) method based on reinforcement learning (FGECRL) to enhance the precision of identifying EC between distinct brain regions. An actor-critic framework with an encoder-decoder model was adopted as the actor network. The encoder utilizes a transformer model; the decoder employs a bidirectional long short-term memory network with attention. An FGEC network was constructed for the enrolled participants per fMRI scan, including 65 patients with tinnitus and 28 control participants healthy at the enrollment time. After 6 months of sound therapy for tinnitus and prospective follow-up, fMRI data were acquired again and retrospectively categorized into an effective group (EG) and an ineffective group (IG) according to the treatment effect. Compared with FC and EC, the FGECRL method demonstrated better accuracy in discriminating between different groups, highlighting the advantage of FGECRL in identifying brain network features. For the FGEC network of the EG and IG per state (before and after treatment) and healthy controls, effective therapy is characterized by a similar pattern of FGEC network between patients with tinnitus after treatment and healthy controls. Deactivated information output in the motor network, somatosensory network, and medioventral occipital cortex may biologically indicate effective treatment. The maintenance of decreased EC in the primary auditory cortex may represent a failure of sound therapy, further supporting the Bayesian inference theory for tinnitus perception. The FGEC network can provide direct evidence for the mechanism of sound therapy in patients with tinnitus with distinct outcomes.