Global Transformer and Dual Local Attention Network via Deep-Shallow Hierarchical Feature Fusion for Retinal Vessel Segmentation

• Published in: IEEE transactions on cybernetics Vol. 53; no. 9; pp. 5826 - 5839
• Main Authors: Li, Yang, Zhang, Yue, Liu, Jing-Yu, Wang, Kang, Zhang, Kai, Zhang, Gen-Sheng, Liao, Xiao-Feng, Yang, Guang
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.09.2023; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Algorithms; Blood vessels; Decoding; Deep-shallow hierarchical feature fusion (dsHFF); dual local attention (DLA); Edge detection; Feature extraction; global transformer (GT); Image edge detection; Image Processing, Computer-Assisted; Image segmentation; medical image analysis; Medical imaging; Retinal images; retinal vessel segmentation; Retinal vessels; Retinal Vessels - diagnostic imaging; Semantics; Transformers
• ISSN: 2168-2267; 2168-2275; 2168-2275
• DOI: 10.1109/TCYB.2022.3194099

Clinically, retinal vessel segmentation is a significant step in the diagnosis of fundus diseases. However, recent methods generally neglect the difference of semantic information between deep and shallow features, which fail to capture the global and local characterizations in fundus images simultaneously, resulting in the limited segmentation performance for fine vessels. In this article, a global transformer (GT) and dual local attention (DLA) network via deep-shallow hierarchical feature fusion (GT-DLA-dsHFF) are investigated to solve the above limitations. First, the GT is developed to integrate the global information in the retinal image, which effectively captures the long-distance dependence between pixels, alleviating the discontinuity of blood vessels in the segmentation results. Second, DLA, which is constructed using dilated convolutions with varied dilation rates, unsupervised edge detection, and squeeze-excitation block, is proposed to extract local vessel information, consolidating the edge details in the segmentation result. Finally, a novel deep-shallow hierarchical feature fusion (dsHFF) algorithm is studied to fuse the features in different scales in the deep learning framework, respectively, which can mitigate the attenuation of valid information in the process of feature fusion. We verified the GT-DLA-dsHFF on four typical fundus image datasets. The experimental results demonstrate our GT-DLA-dsHFF achieves superior performance against the current methods and detailed discussions verify the efficacy of the proposed three modules. Segmentation results of diseased images show the robustness of our proposed GT-DLA-dsHFF. Implementation codes will be available on https://github.com/YangLibuaa/GT-DLA-dsHFF .