Cervical cell classification with graph convolutional network

• Published in: Computer methods and programs in biomedicine Vol. 198; p. 105807
• Main Authors: Shi, Jun, Wang, Ruoyu, Zheng, Yushan, Jiang, Zhiguo, Zhang, Haopeng, Yu, Lanlan
• Format: Journal Article
• Language: English
• Published: Ireland Elsevier B.V 01.01.2021
• Subjects: Cervical cancer screening; Cervical cell classification; Cervical cytology; Early Detection of Cancer; Female; Graph convolutional network; Humans; Image Processing, Computer-Assisted; Neural Networks, Computer; Uterine Cervical Neoplasms - diagnostic imaging; Cervical cytology; Cervical cell classification; Cervical cancer screening; Graph convolutional network
• ISSN: 0169-2607; 1872-7565; 1872-7565
• DOI: 10.1016/j.cmpb.2020.105807

•Graph convolutional network is used to encode the cervical cell image.•The intrinsic relationship exploration of cervical cells contributes significant improvements to the cervical cell classification.•The relation-aware representations generated by graph convolutional network greatly improve the discriminant ability of CNN features.•A large-scale Motic liquid-based cytology image dataset is proposed, which provides the large amount of data, some novel cell types with important clinical significance and staining difference.•The proposed method is compared with existing state-of-the-art cervical cell classification methods and experimentalresults show great potential to be applied in automatic screening system of cervical cytology. Cervical cell classification has important clinical significance in cervical cancer screening at early stages. In contrast with the conventional classification methods which depend on hand-crafted or engineered features, Convolutional Neural Network (CNN) generally classifies cervical cells via learned deep features. However, the latent correlations of images may be ignored during CNN feature learning and thus influence the representation ability of CNN features. We propose a novel cervical cell classification method based on Graph Convolutional Network (GCN). It aims to explore the potential relationship of cervical cell images for improving the classification performance. The CNN features of all the cervical cell images are firstly clustered and the intrinsic relationships of images can be preliminarily revealed through the clustering. To further capture the underlying correlations existed among clusters, a graph structure is constructed. GCN is then applied to propagate the node dependencies and thus yield the relation-aware feature representation. The GCN features are finally incorporated to enhance the discriminative ability of CNN features. Experiments on the public cervical cell image dataset SIPaKMeD from International Conference on Image Processing in 2018 demonstrate the feasibility and effectiveness of the proposed method. In addition, we introduce a large-scale Motic liquid-based cytology image dataset which provides the large amount of data, some novel cell types with important clinical significance and staining difference and thus presents a great challenge for cervical cell classification. We evaluate the proposed method under two conditions of the consistent staining and different staining. Experimental results show our method outperforms the existing state-of-arts methods according to the quantitative metrics (i.e. accuracy, sensitivity, specificity, F-measure and confusion matrices). The intrinsic relationship exploration of cervical cells contributes significant improvements to the cervical cell classification. The relation-aware features generated by GCN effectively strengthens the representational power of CNN features. The proposed method can achieve the better classification performance and also can be potentially used in automatic screening system of cervical cytology. [Display omitted]