Key Technology Considerations in Developing and Deploying Machine Learning Models in Clinical Radiology Practice

• Published in: JMIR medical informatics Vol. 9; no. 9; p. e28776
• Main Authors: Kulkarni, Viraj, Gawali, Manish, Kharat, Amit
• Format: Journal Article
• Language: English
• Published: Canada JMIR Publications 09.09.2021
• Subjects: Algorithms; Annotations; Artificial intelligence; Automation; Datasets; Ethnicity; Machine learning; Neural networks; Privacy; Software; Viewpoint; deep learning; radiology; neural networks; AI; privacy; machine learning; artificial intelligence; deployment
• ISSN: 2291-9694; 2291-9694
• DOI: 10.2196/28776

The use of machine learning to develop intelligent software tools for the interpretation of radiology images has gained widespread attention in recent years. The development, deployment, and eventual adoption of these models in clinical practice, however, remains fraught with challenges. In this paper, we propose a list of key considerations that machine learning researchers must recognize and address to make their models accurate, robust, and usable in practice. We discuss insufficient training data, decentralized data sets, high cost of annotations, ambiguous ground truth, imbalance in class representation, asymmetric misclassification costs, relevant performance metrics, generalization of models to unseen data sets, model decay, adversarial attacks, explainability, fairness and bias, and clinical validation. We describe each consideration and identify the techniques used to address it. Although these techniques have been discussed in prior research, by freshly examining them in the context of medical imaging and compiling them in the form of a laundry list, we hope to make them more accessible to researchers, software developers, radiologists, and other stakeholders.