COVID-19 identification in chest X-ray images on flat and hierarchical classification scenarios

• Published in: Computer methods and programs in biomedicine Vol. 194; p. 105532
• Main Authors: Pereira, Rodolfo M., Bertolini, Diego, Teixeira, Lucas O., Silla, Carlos N., Costa, Yandre M.G.
• Format: Journal Article
• Language: English
• Published: Ireland Elsevier B.V 01.10.2020
• Subjects: Algorithms; Betacoronavirus; Chest X-ray; Clinical Laboratory Techniques; Coronavirus Infections - diagnosis; Coronavirus Infections - diagnostic imaging; COVID-19; COVID-19 Testing; Databases, Factual; Deep Learning; Humans; Image Processing, Computer-Assisted - methods; Lung - diagnostic imaging; Medical image analysis; Pandemics; Pneumonia; Pneumonia, Viral - diagnostic imaging; Radiography, Thoracic - methods; SARS-CoV-2; Software; Texture; Tomography, X-Ray Computed; X-Rays; COVID-19; Pneumonia; Chest X-ray; Texture; Medical image analysis
• DOI: 10.1016/j.cmpb.2020.105532
• ISSN: 0169-2607; 1872-7565

•COVID-19 identification in chest X-ray using multi-class and hierarchical learners.•Using a database that reflects a real world scenario with its natural imbalance.•Exploring the textural content from the chest X-ray images with pneumonia.•Evaluating handcrafted and learned features to investigate its complementarities. [Display omitted] Background and Objective:The COVID-19 can cause severe pneumonia and is estimated to have a high impact on the healthcare system. Early diagnosis is crucial for correct treatment in order to possibly reduce the stress in the healthcare system. The standard image diagnosis tests for pneumonia are chest X-ray (CXR) and computed tomography (CT) scan. Although CT scan is the gold standard, CXR are still useful because it is cheaper, faster and more widespread. This study aims to identify pneumonia caused by COVID-19 from other types and also healthy lungs using only CXR images. Methods:In order to achieve the objectives, we have proposed a classification schema considering the following perspectives: i) a multi-class classification; ii) hierarchical classification, since pneumonia can be structured as a hierarchy. Given the natural data imbalance in this domain, we also proposed the use of resampling algorithms in the schema in order to re-balance the classes distribution. We observed that, texture is one of the main visual attributes of CXR images, our classification schema extract features using some well-known texture descriptors and also using a pre-trained CNN model. We also explored early and late fusion techniques in the schema in order to leverage the strength of multiple texture descriptors and base classifiers at once. To evaluate the approach, we composed a database, named RYDLS-20, containing CXR images of pneumonia caused by different pathogens as well as CXR images of healthy lungs. The classes distribution follows a real-world scenario in which some pathogens are more common than others. Results:The proposed approach tested in RYDLS-20 achieved a macro-avg F1-Score of 0.65 using a multi-class approach and a F1-Score of 0.89 for the COVID-19 identification in the hierarchical classification scenario. Conclusions:As far as we know, the top identification rate obtained in this paper is the best nominal rate obtained for COVID-19 identification in an unbalanced environment with more than three classes. We must also highlight the novel proposed hierarchical classification approach for this task, which considers the types of pneumonia caused by the different pathogens and lead us to the best COVID-19 recognition rate obtained here.