Automatic Grading Assessments for Knee MRI Cartilage Defects via Self-ensembling Semi-supervised Learning with Dual-Consistency

• Published in: Medical image analysis Vol. 80; p. 102508
• Main Authors: Huo, Jiayu, Ouyang, Xi, Si, Liping, Xuan, Kai, Wang, Sheng, Yao, Weiwu, Liu, Ying, Xu, Jia, Qian, Dahong, Xue, Zhong, Wang, Qian, Shen, Dinggang, Zhang, Lichi
• Format: Journal Article
• Language: English
• Published: 01.08.2022
• ISSN: 1361-8415; 1361-8423; 1361-8423
• DOI: 10.1016/j.media.2022.102508

Knee cartilage defects caused by osteoarthritis are major musculoskeletal disorders, leading to joint necrosis or even disability if not intervened at early stage. Deep learning has demonstrated its effectiveness in computer-aided diagnosis, but it is time-consuming to prepare a large set of well-annotated data by experienced radiologists for model training. In this paper, we propose a semi-supervised framework to effectively use unlabeled data for better evaluation of knee cartilage defect grading. Our framework is developed based on the widely-used mean-teacher classification model, by designing a novel dual-consistency strategy to boost the consistency between the teacher and student models. The main contributions are three-fold: (1) We define an attention loss function to make the network focus on the cartilage regions, which can both achieve accurate attention masks and boost classification performance simultaneously; (2) Besides enforcing the consistency of classification results, we further design a novel attention consistency mechanism to ensure the focusing of the student and teacher networks on the same defect regions; (3) We introduce an aggregation approach to ensemble the slice-level classification outcomes for deriving the final subject-level diagnosis. Experimental results show that our proposed method can significantly improve both classification and localization performances of knee cartilage defects. Our code is available on https://github.com/King-HAW/DC-MT.Knee cartilage defects caused by osteoarthritis are major musculoskeletal disorders, leading to joint necrosis or even disability if not intervened at early stage. Deep learning has demonstrated its effectiveness in computer-aided diagnosis, but it is time-consuming to prepare a large set of well-annotated data by experienced radiologists for model training. In this paper, we propose a semi-supervised framework to effectively use unlabeled data for better evaluation of knee cartilage defect grading. Our framework is developed based on the widely-used mean-teacher classification model, by designing a novel dual-consistency strategy to boost the consistency between the teacher and student models. The main contributions are three-fold: (1) We define an attention loss function to make the network focus on the cartilage regions, which can both achieve accurate attention masks and boost classification performance simultaneously; (2) Besides enforcing the consistency of classification results, we further design a novel attention consistency mechanism to ensure the focusing of the student and teacher networks on the same defect regions; (3) We introduce an aggregation approach to ensemble the slice-level classification outcomes for deriving the final subject-level diagnosis. Experimental results show that our proposed method can significantly improve both classification and localization performances of knee cartilage defects. Our code is available on https://github.com/King-HAW/DC-MT.