Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation
[Display omitted] •It is critical for EHR-integrated innovations to be systematically evaluated.•Effective evaluation of EHR-integrated innovations requires a shared understanding and collaboration across disciplines throughout the full information technology (IT) life cycle.•A novel Evaluation in L...
Saved in:
Published in | Journal of biomedical informatics Vol. 127; p. 104014 |
---|---|
Main Authors | , , , , , , , , , , , , , , , , |
Format | Journal Article |
Language | English |
Published |
United States
Elsevier Inc
01.03.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | [Display omitted]
•It is critical for EHR-integrated innovations to be systematically evaluated.•Effective evaluation of EHR-integrated innovations requires a shared understanding and collaboration across disciplines throughout the full information technology (IT) life cycle.•A novel Evaluation in Life Cycle of Information Technology (ELICIT) framework focuses on all phases of the IT life cycle.•The ELICIT framework consists of 12 evaluation steps across the IT life cycle phases including society-, user-, and IT-level measures.
Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation.
The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies.
The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment.
Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation.
As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations. |
---|---|
Bibliography: | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-3 content type line 23 ObjectType-Review-2 AUTHOR CONTRIBUTIONS Polina V. Kukhareva: Conceptualization, Methodology, Formal analysis, Investigation, Data Curation, Writing - Original Draft, Writing - Review & Editing, Visualization, Project administration. Charlene Weir: Methodology, Formal analysis, Investigation, Writing - Review & Editing, Supervision. Guilherme Del Fiol: Methodology, Formal analysis, Investigation, Writing - Review & Editing, Supervision. Gregory A. Aarons: Writing - Review & Editing. Teresa Y. Taft: Formal analysis, Writing - Review & Editing. Chelsey R. Schlechter: Formal analysis, Writing - Review & Editing. Thomas J. Reese: Writing - Review & Editing. Rebecca L. Curran: Writing - Review & Editing. Claude Nanjo: Formal analysis, Writing - Review & Editing. Damian Borbolla: Writing - Review & Editing. Catherine J Staes: Writing - Review & Editing. Keaton L. Morgan, MD, MS: Writing - Review & Editing. Heidi S. Kramer: Writing - Review & Editing. Carole H. Stipelman: Formal analysis, Writing - Review & Editing. Julie H. Shakib: Formal analysis, Writing - Review & Editing. Michael C. Flynn: Writing - Review & Editing. Kensaku Kawamoto: Methodology, Formal analysis, Investigation, Supervision, Funding acquisition. |
ISSN: | 1532-0464 1532-0480 |
DOI: | 10.1016/j.jbi.2022.104014 |