Separation of color channels from conventional colonoscopy images improves deep neural network detection of polyps

• Published in: Journal of biomedical optics Vol. 26; no. 1; p. 015001
• Main Authors: Lai, Lily L, Blakely, Andrew, Invernizzi, Marta, Lin, James, Kidambi, Trilokesh, Melstrom, Kurt A, Yu, Kevin, Lu, Thomas
• Format: Journal Article
• Language: English
• Published: United States Society of Photo-Optical Instrumentation Engineers 01.01.2021; S P I E - International Society for
• Subjects: Artificial intelligence; Artificial neural networks; Cancer; Channels; Colon; Colonoscopy; Color; Color imagery; Colorectal carcinoma; Endoscopy; Image acquisition; Image processing; Machine learning; Medical imaging; Multilayers; Neural networks; Patients; Polyps; Rectum; Separation; Surveillance; Tumors; White light; artificial intelligence algorithms; deep learning; color channel separation; colorectal cancer; polyp discrimination; narrow-band imaging
• ISSN: 1083-3668; 1560-2281
• DOI: 10.1117/1.JBO.26.1.015001

Significance: Colorectal cancer incidence has decreased largely due to detection and removal of polyps. Computer-aided diagnosis development may improve on polyp detection and discrimination. Aim: To advance detection and discrimination using currently available commercial colonoscopy systems, we developed a deep neural network (DNN) separating the color channels from images acquired under narrow-band imaging (NBI) and white-light endoscopy (WLE). Approach: Images of normal colon mucosa and polyps from colonoscopies were studied. Each color image was extracted based on the color channel: red/green/blue. A multilayer DNN was trained using one-channel, two-channel, and full-color images. The trained DNN was then tested for performance in detection of polyps. Results: The DNN performed better using full-colored NBI over WLE images in the detection of polyps. Furthermore, the DNN performed better using the two-channel red + green images when compared to full-color WLE images. Conclusions: The separation of color channels from full-color NBI and WLE images taken from commercially available colonoscopes may improve the ability of the DNN to detect and discriminate polyps. Further studies are needed to better determine the color channels and combination of channels to include and exclude in DNN development for clinical use.