Center-Focusing Multi-task CNN with Injected Features for Classification of Glioma Nuclear Images

• Published in: 2017 IEEE Winter Conference on Applications of Computer Vision (WACV) Vol. 2017; pp. 834 - 841
• Main Authors: Murthy, Veda, Le Hou, Samaras, Dimitris, Kurc, Tahsin M., Saltz, Joel H.
• Format: Conference Proceeding Journal Article
• Language: English
• Published: United States IEEE 01.03.2017
• Subjects: Computer vision; Conferences; Decision support systems; Handheld computers
• ISSN: 2472-6737
• DOI: 10.1109/WACV.2017.98

Classifying the various shapes and attributes of a glioma cell nucleus is crucial for diagnosis and understanding of the disease. We investigate the automated classification of the nuclear shapes and visual attributes of glioma cells, using Convolutional Neural Networks (CNNs) on pathology images of automatically segmented nuclei. We propose three methods that improve the performance of a previously-developed semi-supervised CNN. First, we propose a method that allows the CNN to focus on the most important part of an image-the image's center containing the nucleus. Second, we inject (concatenate) pre-extracted VGG features into an intermediate layer of our Semi-Supervised CNN so that during training, the CNN can learn a set of additional features. Third, we separate the losses of the two groups of target classes (nuclear shapes and attributes) into a single-label loss and a multi-label loss in order to incorporate prior knowledge of inter-label exclusiveness. On a dataset of 2078 images, the combination of the proposed methods reduces the error rate of attribute and shape classification by 21.54% and 15.07% respectively compared to the existing state-of-the-art method on the same dataset.