A Comparative Study of Deep Neural Networks for Real-Time Semantic Segmentation during the Transurethral Resection of Bladder Tumors

• Published in: Diagnostics (Basel) Vol. 12; no. 11; p. 2849
• Main Authors: Varnyú, Dóra, Szirmay-Kalos, László
• Format: Journal Article
• Language: English
• Published: Switzerland MDPI AG 01.11.2022; MDPI
• Subjects: Accuracy; Bladder cancer; Classification; convolutional neural network; Cystoscopy; Deep learning; Diagnosis; Excision (Surgery); guided filtering; Image segmentation; Light; Localization; Medical diagnosis; Methods; Neural networks; semantic segmentation; Semantics; Technology application; transfer learning; Tumors; Urology; white-light cystoscopy; Hungary; transfer learning; bladder cancer; convolutional neural network; unsharp masking; white-light cystoscopy; semantic segmentation; guided filtering
• ISSN: 2075-4418; 2075-4418
• DOI: 10.3390/diagnostics12112849

Bladder cancer is a common and often fatal disease. Papillary bladder tumors are well detectable using cystoscopic imaging, but small or flat lesions are frequently overlooked by urologists. However, detection accuracy can be improved if the images from the cystoscope are segmented in real time by a deep neural network (DNN). In this paper, we compare eight state-of-the-art DNNs for the semantic segmentation of white-light cystoscopy images: U-Net, UNet++, MA-Net, LinkNet, FPN, PAN, DeepLabv3, and DeepLabv3+. The evaluation includes per-image classification accuracy, per-pixel localization accuracy, prediction speed, and model size. Results show that the best F-score for bladder cancer (91%), the best segmentation map precision (92.91%), and the lowest size (7.93 MB) are also achieved by the PAN model, while the highest speed (6.73 ms) is obtained by DeepLabv3+. These results indicate better tumor localization accuracy than reported in previous studies. It can be concluded that deep neural networks may be extremely useful in the real-time diagnosis and therapy of bladder cancer, and among the eight investigated models, PAN shows the most promising results.