Developing a reporting guideline for artificial intelligence-centred diagnostic test accuracy studies: the STARD-AI protocol

• Published in: BMJ open Vol. 11; no. 6; p. e047709
• Main Authors: Sounderajah, Viknesh, Ashrafian, Hutan, Golub, Robert M, Shetty, Shravya, De Fauw, Jeffrey, Hooft, Lotty, Moons, Karel, Collins, Gary, Moher, David, Bossuyt, Patrick M, Darzi, Ara, Karthikesalingam, Alan, Denniston, Alastair K, Mateen, Bilal Akhter, Ting, Daniel, Treanor, Darren, King, Dominic, Greaves, Felix, Godwin, Jonathan, Pearson-Stuttard, Jonathan, Harling, Leanne, McInnes, Matthew, Rifai, Nader, Tomasev, Nenad, Normahani, Pasha, Whiting, Penny, Aggarwal, Ravi, Vollmer, Sebastian, Markar, Sheraz R, Panch, Trishan, Liu, Xiaoxuan
• Format: Journal Article
• Language: English
• Published: England British Medical Journal Publishing Group 28.06.2021; BMJ Publishing Group LTD; BMJ Publishing Group
• Series: Protocol
• Subjects: Accuracy; Algorithms; Artificial Intelligence; Diagnostic tests; Diagnostic Tests, Routine; Health Informatics; Humans; Literature reviews; London; Medical diagnosis; protocols & guidelines; quality in health care; Quality standards; Research Design; Research Report; Social research; Subject heading schemes; London; protocols & guidelines; health informatics; quality in health care
• ISSN: 2044-6055; 2044-6055
• DOI: 10.1136/bmjopen-2020-047709

IntroductionStandards for Reporting of Diagnostic Accuracy Study (STARD) was developed to improve the completeness and transparency of reporting in studies investigating diagnostic test accuracy. However, its current form, STARD 2015 does not address the issues and challenges raised by artificial intelligence (AI)-centred interventions. As such, we propose an AI-specific version of the STARD checklist (STARD-AI), which focuses on the reporting of AI diagnostic test accuracy studies. This paper describes the methods that will be used to develop STARD-AI.Methods and analysisThe development of the STARD-AI checklist can be distilled into six stages. (1) A project organisation phase has been undertaken, during which a Project Team and a Steering Committee were established; (2) An item generation process has been completed following a literature review, a patient and public involvement and engagement exercise and an online scoping survey of international experts; (3) A three-round modified Delphi consensus methodology is underway, which will culminate in a teleconference consensus meeting of experts; (4) Thereafter, the Project Team will draft the initial STARD-AI checklist and the accompanying documents; (5) A piloting phase among expert users will be undertaken to identify items which are either unclear or missing. This process, consisting of surveys and semistructured interviews, will contribute towards the explanation and elaboration document and (6) On finalisation of the manuscripts, the group’s efforts turn towards an organised dissemination and implementation strategy to maximise end-user adoption.Ethics and disseminationEthical approval has been granted by the Joint Research Compliance Office at Imperial College London (reference number: 19IC5679). A dissemination strategy will be aimed towards five groups of stakeholders: (1) academia, (2) policy, (3) guidelines and regulation, (4) industry and (5) public and non-specific stakeholders. We anticipate that dissemination will take place in Q3 of 2021.