Polyp Tracking in Video Colonoscopy Using Optical Flow With an On-The-Fly Trained CNN

Colonoscopy has been widely applied as a common practice to inspect the inside of large bowel for colon cancer screening. However, missing polyps in such procedure could happen and thus preventing early disease detection and treatment. In this paper, we propose an algorithm for automatic polyp detec...

Full description

Saved in:
Bibliographic Details
Published in2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019) pp. 79 - 82
Main Authors Zheng, He, Chen, Hanbo, Huang, Junzhou, Li, Xuzhi, Han, Xiao, Yao, Jianhua
Format Conference Proceeding
LanguageEnglish
Published IEEE 01.04.2019
Subjects
Colonoscopy
Feature extraction
motion regression
on-the-fly trained cnn
optical flow
Optical imaging
polyp detection
polyp localization
Solid modeling
Task analysis
Tracking
Training
video colonoscopy
Online AccessGet full text

Cover

More Information
Summary:Colonoscopy has been widely applied as a common practice to inspect the inside of large bowel for colon cancer screening. However, missing polyps in such procedure could happen and thus preventing early disease detection and treatment. In this paper, we propose an algorithm for automatic polyp detection and localization in colonoscopy video. The method initially detects and localizes polyps based on single frame object detection or segmentation network such as U-Net. Then it utilizes optical flow to track polyps and fuse temporal information. To overcome tracking failure caused by motion effects, a motion regression model and an efficient on-the-fly trained CNN have been deployed. The proposed algorithm achieves the highest scores in both polyp detection task and polyp localization task in the MICCAI 2018 Endoscopic Vision Challenge on "Gastrointestinal Image Analysis".
ISSN:1945-8452
DOI:10.1109/ISBI.2019.8759180