Hybrid models for classifying histological images: An association of deep features by transfer learning with ensemble classifier

• Published in: Multimedia tools and applications Vol. 83; no. 8; pp. 21929 - 21952
• Main Authors: de Oliveira, Cléber I., do Nascimento, Marcelo Z., Roberto, Guilherme F., Tosta, Thaína A. A., Martins, Alessandro S., Neves, Leandro A.
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.03.2024; Springer Nature B.V
• Subjects: Accuracy; Algorithms; Artificial neural networks; Associations; Breast cancer; Classification; Classifiers; Computer Communication Networks; Computer Science; Data augmentation; Data Structures and Information Theory; Datasets; Discriminant analysis; Ensemble learning; Feature selection; Image classification; Investigations; Machine learning; Medical imaging; Multimedia; Multimedia Information Systems; Neural networks; Pattern recognition; Special Purpose and Application-Based Systems; Deep features; Pattern recognition; Histological images; Transfer learning; Hybrid models
• ISSN: 1573-7721; 1380-7501; 1573-7721
• DOI: 10.1007/s11042-023-16351-4

The use of a convolutional neural network with transfer learning is a strategy that defines high-level features, commonly explored to study patterns in medical images. These features can be analyzed via different methods in order to design hybrid models with more useful and accurate solutions for clinical practice. In this paper, a computational scheme is presented to define hybrid models through deep features by transfer learning, selection by ranking and a robust ensemble classifier with five algorithms. The obtained models were applied to classify histological images from breast, colorectal and liver tissue. The strategy developed here allows knowing important results and conditions to improve models of computer-aided diagnosis, even exploring classic CNN models. The features were defined using layers from the AlexNet and ResNet-50 architectures. The attributes were organized into subsets of the most relevant features and submitted to a k -fold cross-validation process. The best hybrid models were obtained with deep features from the ResNet-50 network, using distinct layers ( activation_48_relu and avg_pool ) and a maximum of 35 descriptors. These hybrid models provided 98.00% and 99.32% of accuracy values, with emphasis on histological images of breast cancer, indicating the best solution among those available in the specialized Literature. Also, these models provided more relevant results for classifying UCSB and LG datasets than regularized techniques and CNN architectures, exploring data augmentation or not. The computational scheme with detailed information regarding the main hybrid models is a relevant contribution to the community interested in the study of machine learning techniques for pattern recognition.