TransBridge: A Lightweight Transformer for Left Ventricle Segmentation in Echocardiography

• Published in: Simplifying Medical Ultrasound Vol. 12967; pp. 63 - 72
• Main Authors: Deng, Kaizhong, Meng, Yanda, Gao, Dongxu, Bridge, Joshua, Shen, Yaochun, Lip, Gregory, Zhao, Yitian, Zheng, Yalin
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2021; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Echocardiography; Left ventricle segmentation; Lightweight transformer model; Parameter efficiency
• ISBN: 3030875822; 9783030875824
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-030-87583-1_7

Echocardiography is an essential diagnostic method to assess cardiac functions. However, manually labelling the left ventricle region on echocardiography images is time-consuming and subject to observer bias. Therefore, it is vital to develop a high-performance and efficient automatic assessment tool. Inspired by the success of the transformer structure in vision tasks, we develop a lightweight model named ‘TransBridge’ for segmentation tasks. This hybrid framework combines a convolutional neural network (CNN) encoder-decoder structure and a transformer structure. The transformer layers bridge the CNN encoder and decoder to fuse the multi-level features extracted by the CNN encoder, to build global and inter-level dependencies. A new patch embedding layer has been implemented using the dense patch division method and shuffled group convolution to reduce the excessive parameter number in the embedding layer and the size of the token sequence. The model is evaluated on the EchoNet-Dynamic dataset for the left ventricle segmentation task. The experimental results show that the total number of parameters is reduced by 78.7% compared to CoTr [22] and the Dice coefficient reaches 91.4%, proving the structure’s effectiveness.