Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation
[Display omitted] •It is critical for EHR-integrated innovations to be systematically evaluated.•Effective evaluation of EHR-integrated innovations requires a shared understanding and collaboration across disciplines throughout the full information technology (IT) life cycle.•A novel Evaluation in L...
Saved in:
Published in | Journal of biomedical informatics Vol. 127; p. 104014 |
---|---|
Main Authors | , , , , , , , , , , , , , , , , |
Format | Journal Article |
Language | English |
Published |
United States
Elsevier Inc
01.03.2022
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | [Display omitted]
•It is critical for EHR-integrated innovations to be systematically evaluated.•Effective evaluation of EHR-integrated innovations requires a shared understanding and collaboration across disciplines throughout the full information technology (IT) life cycle.•A novel Evaluation in Life Cycle of Information Technology (ELICIT) framework focuses on all phases of the IT life cycle.•The ELICIT framework consists of 12 evaluation steps across the IT life cycle phases including society-, user-, and IT-level measures.
Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation.
The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies.
The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment.
Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation.
As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations. |
---|---|
AbstractList | Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation.
The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies.
The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment.
Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation.
As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations. [Display omitted] •It is critical for EHR-integrated innovations to be systematically evaluated.•Effective evaluation of EHR-integrated innovations requires a shared understanding and collaboration across disciplines throughout the full information technology (IT) life cycle.•A novel Evaluation in Life Cycle of Information Technology (ELICIT) framework focuses on all phases of the IT life cycle.•The ELICIT framework consists of 12 evaluation steps across the IT life cycle phases including society-, user-, and IT-level measures. Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. The evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. The resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. Effective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. As health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations. OBJECTIVEOur objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four information technology (IT) life cycle phases: planning, development, implementation, and operation. METHODSThe evaluation framework was developed based on a review of existing evaluation frameworks from health informatics and other domains (human factors engineering, software engineering, and social sciences); expert consensus; and real-world testing in multiple EHR-integrated innovation studies. RESULTSThe resulting Evaluation in Life Cycle of IT (ELICIT) framework covers four IT life cycle phases and three measure levels (society, user, and IT). The ELICIT framework recommends 12 evaluation steps: (1) business case assessment; (2) stakeholder requirements gathering; (3) technical requirements gathering; (4) technical acceptability assessment; (5) user acceptability assessment; (6) social acceptability assessment; (7) social implementation assessment; (8) initial user satisfaction assessment; (9) technical implementation assessment; (10) technical portability assessment; (11) long-term user satisfaction assessment; and (12) social outcomes assessment. DISCUSSIONEffective evaluation requires a shared understanding and collaboration across disciplines throughout the entire IT life cycle. In contrast with previous evaluation frameworks, the ELICIT framework focuses on all phases of the IT life cycle across the society, user, and IT levels. Institutions seeking to establish evaluation programs for EHR-integrated innovations could use our framework to create such shared understanding and justify the need to invest in evaluation. CONCLUSIONAs health care undergoes a digital transformation, it will be critical for EHR-integrated innovations to be systematically evaluated. The ELICIT framework can facilitate these evaluations. |
ArticleNumber | 104014 |
Author | Del Fiol, Guilherme Kukhareva, Polina V. Aarons, Gregory A. Curran, Rebecca L. Kawamoto, Kensaku Schlechter, Chelsey R. Borbolla, Damian Reese, Thomas J. Taft, Teresa Y. Stipelman, Carole H. Shakib, Julie H. Nanjo, Claude Staes, Catherine J. Weir, Charlene Kramer, Heidi S. Morgan, Keaton L. Flynn, Michael C. |
Author_xml | – sequence: 1 givenname: Polina V. surname: Kukhareva fullname: Kukhareva, Polina V. email: polina.kukhareva@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 2 givenname: Charlene surname: Weir fullname: Weir, Charlene email: charlene.weir@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 3 givenname: Guilherme surname: Del Fiol fullname: Del Fiol, Guilherme email: guilherme.delfiol@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 4 givenname: Gregory A. surname: Aarons fullname: Aarons, Gregory A. email: gaarons@health.ucsd.edu organization: Department of Psychiatry, UC San Diego ACTRI Dissemination and Implementation Science Center, UC San Diego, La Jolla, CA, USA – sequence: 5 givenname: Teresa Y. surname: Taft fullname: Taft, Teresa Y. email: teresa.taft@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 6 givenname: Chelsey R. surname: Schlechter fullname: Schlechter, Chelsey R. email: chelsey.schlechter@hci.utah.edu organization: Department of Population Health Sciences, Center for Health Outcomes and Population Equity, Huntsman Cancer Institute, University of Utah, Salt Lake City, UT, USA – sequence: 7 givenname: Thomas J. surname: Reese fullname: Reese, Thomas J. email: thomas.reese@vumc.org organization: Department of Biomedical Informatics, Vanderbilt University, Nashville, TN, USA – sequence: 8 givenname: Rebecca L. surname: Curran fullname: Curran, Rebecca L. email: rebecca.curran@hsc.utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 9 givenname: Claude surname: Nanjo fullname: Nanjo, Claude email: claude.nanjo@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 10 givenname: Damian surname: Borbolla fullname: Borbolla, Damian email: damian.borbolla@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 11 givenname: Catherine J. surname: Staes fullname: Staes, Catherine J. email: catherine.staes@hsc.utah.edu organization: College of Nursing, University of Utah, Salt Lake City, UT, USA – sequence: 12 givenname: Keaton L. surname: Morgan fullname: Morgan, Keaton L. email: keaton.morgan@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 13 givenname: Heidi S. surname: Kramer fullname: Kramer, Heidi S. email: heidi.kramer@hsc.utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA – sequence: 14 givenname: Carole H. surname: Stipelman fullname: Stipelman, Carole H. email: carole.stipelman@hsc.utah.edu organization: Department of Pediatrics, University of Utah, Salt Lake City, UT, USA – sequence: 15 givenname: Julie H. surname: Shakib fullname: Shakib, Julie H. email: julie.shakib@hsc.utah.edu organization: Department of Pediatrics, University of Utah, Salt Lake City, UT, USA – sequence: 16 givenname: Michael C. surname: Flynn fullname: Flynn, Michael C. email: michael.flynn@hsc.utah.edu organization: Department of Pediatrics, University of Utah, Salt Lake City, UT, USA – sequence: 17 givenname: Kensaku surname: Kawamoto fullname: Kawamoto, Kensaku email: kensaku.kawamoto@utah.edu organization: Department of Biomedical Informatics, University of Utah, Salt Lake City, UT, USA |
BackLink | https://www.ncbi.nlm.nih.gov/pubmed/35167977$$D View this record in MEDLINE/PubMed |
BookMark | eNp9UcuO0zAUtdAgZqbwAWyQl8OixY_YSUAaCVUdqFSJBWVtOc5N65LYxU6C-jn86bhkqGDDyte656V7btGV8w4Qek3JghIq3x0Wh8ouGGEs_TNCs2fohgrO5iQryNVlltk1uo3xQAilQsgX6JoLKvMyz2_Qr9Wo20H31jtsHd7YBvDyZFrAvsFr1_jQTcstmL3zrd-d8N1qs16ut29xE3QHP334_h5_HY5HH3rrdrjfQ5JyfpyI7VnS_JZsgu9wNUTrIEZsdASsY0xzB67Hvcdx6M52I2C4xHqJnje6jfDq6Z2hbw-r7fLzfPPl03r5cTM3maD9XNNKa5JxJjQXpCx4UeqqLkpBWC4lJYLXkouyYSwzxuSFBlHqDGRdcNIQTvkM3U-6x6HqoDYpUtCtOgbb6XBSXlv178bZvdr5USWPkqRTz9Ddk0DwPwaIvepsNNC22oEfomKSlbyQGSkTlE5QE3yMAZqLDSXqXK06qFStOlerpmoT583f-S6MP10mwIcJAOlKo4WgorHgDNQ2gOlV7e1_5B8B3Wa5Mw |
CitedBy_id | crossref_primary_10_1186_s13012_023_01261_8 crossref_primary_10_1200_CCI_23_00187 crossref_primary_10_28925_2663_4023_2022_18_138149 crossref_primary_10_17721_2415_881x_2023_90_351_366 crossref_primary_10_1093_jamiaopen_ooae038 crossref_primary_10_25130_tjaes_18_60_2_32 crossref_primary_10_1093_jamiaopen_ooad105 |
Cites_doi | 10.1016/j.jbi.2004.01.003 10.1001/jama.1996.03540080059030 10.1016/j.ijmedinf.2020.104247 10.1016/j.ijmedinf.2016.10.008 10.1093/jamia/ocv189 10.2105/AJPH.89.9.1322 10.1093/jamiaopen/ooab041 10.12927/hcq.2010.21967 10.1016/j.ijmedinf.2007.08.011 10.1016/j.ijmedinf.2005.07.007 10.1016/S1386-5056(03)00131-X 10.1161/CIRCOUTCOMES.119.006286 10.1186/1748-5908-4-50 10.1186/s13012-018-0842-6 10.3414/ME10-01-0066 10.1080/07421222.2003.11045748 10.1371/journal.pone.0134977 10.7326/M19-0874 10.2196/12902 10.1001/jama.2021.5487 10.1016/j.ijmedinf.2011.08.004 10.1016/j.cels.2015.05.001 10.1016/j.jacr.2020.09.060 10.1002/jhm.2433 10.1136/bmjqs-2015-004411 10.1093/ofid/ofaa497 10.1016/S0166-4115(08)62386-9 10.1093/jamiaopen/ooaa033 10.1186/1748-5908-8-139 10.1186/s12913-019-4668-y 10.1207/s15516709cog1801_3 10.1016/j.ijmedinf.2008.09.002 10.2196/18388 10.2196/19676 10.1016/S1386-5056(01)00184-8 10.1093/jamiaopen/ooaa014 10.1007/s10488-010-0327-7 10.1136/amiajnl-2013-002511 10.1016/j.childyouth.2013.10.006 10.1542/peds.2016-2896 10.1001/jama.293.10.1197 10.7326/M13-1531 10.1002/jhm.2552 10.1136/jamia.1994.95236134 10.2307/30036540 10.1016/j.ijmedinf.2007.08.004 10.1186/s13012-018-0751-8 10.7326/M19-0875 10.1093/jamia/ocaa099 10.1016/j.amepre.2016.06.008 10.1201/b12461 10.1016/j.jval.2013.02.002 10.1093/jamia/ocab010 10.1016/j.jbi.2011.08.005 10.1055/s-0041-1728757 10.3390/healthcare6030109 10.1016/j.jbi.2008.03.009 10.15265/IY-2016-013 10.1017/S0266462311000638 10.1093/jamia/ocx106 10.1097/JHQ.0000000000000247 10.1186/s13012-021-01099-y 10.1016/j.jbi.2018.07.009 10.1006/jbin.2001.1002 10.1197/jamia.M1370 10.1016/j.ijmedinf.2004.08.003 10.1001/jamainternmed.2021.2626 10.1016/j.ijmedinf.2004.04.004 10.1186/s13012-019-0898-y 10.1111/j.1468-0009.2010.00598.x 10.1017/S026646232000015X 10.1001/jamanetworkopen.2019.15343 10.1016/j.jbi.2004.11.005 10.1093/jamia/ocaa337 10.1186/s40359-015-0089-9 10.1007/s10488-010-0319-7 10.1145/1764810.1764814 10.2196/jmir.8775 |
ContentType | Journal Article |
Copyright | 2022 The Author(s) Copyright © 2022 The Author(s). Published by Elsevier Inc. All rights reserved. |
Copyright_xml | – notice: 2022 The Author(s) – notice: Copyright © 2022 The Author(s). Published by Elsevier Inc. All rights reserved. |
DBID | 6I. AAFTH CGR CUY CVF ECM EIF NPM AAYXX CITATION 7X8 5PM |
DOI | 10.1016/j.jbi.2022.104014 |
DatabaseName | ScienceDirect Open Access Titles Elsevier:ScienceDirect:Open Access Medline MEDLINE MEDLINE (Ovid) MEDLINE MEDLINE PubMed CrossRef MEDLINE - Academic PubMed Central (Full Participant titles) |
DatabaseTitle | MEDLINE Medline Complete MEDLINE with Full Text PubMed MEDLINE (Ovid) CrossRef MEDLINE - Academic |
DatabaseTitleList | MEDLINE MEDLINE - Academic |
Database_xml | – sequence: 1 dbid: NPM name: PubMed url: https://proxy.k.utb.cz/login?url=http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed sourceTypes: Index Database – sequence: 2 dbid: EIF name: MEDLINE url: https://proxy.k.utb.cz/login?url=https://www.webofscience.com/wos/medline/basic-search sourceTypes: Index Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Medicine Engineering Public Health |
EISSN | 1532-0480 |
EndPage | 104014 |
ExternalDocumentID | 10_1016_j_jbi_2022_104014 35167977 S1532046422000302 |
Genre | Research Support, U.S. Gov't, P.H.S Review Journal Article Research Support, N.I.H., Extramural |
GrantInformation_xml | – fundername: NLM NIH HHS grantid: T15 LM007124 – fundername: AHRQ HHS grantid: R18 HS026198 |
GroupedDBID | --- --K --M -~X .DC .GJ .~1 0R~ 1B1 1RT 1~. 1~5 29J 4.4 457 4G. 53G 5GY 5VS 6I. 7-5 71M 8P~ AACTN AAEDT AAEDW AAFTH AAIAV AAIKJ AAKOC AALRI AAOAW AAQFI AAQXK AAWTL AAXUO AAYFN ABBOA ABBQC ABFRF ABJNI ABLVK ABMAC ABMZM ABVKL ABXDB ABYKQ ACDAQ ACGFO ACGFS ACNNM ACRLP ACZNC ADBBV ADEZE ADFGL ADMUD AEBSH AEFWE AEKER AENEX AEXQZ AFKWA AFTJW AFXIZ AGHFR AGUBO AGYEJ AHZHX AIALX AIEXJ AIKHN AITUG AJBFU AJOXV AJRQY ALMA_UNASSIGNED_HOLDINGS AMFUW AMRAJ ANZVX AOUOD ASPBG AVWKF AXJTR AZFZN BAWUL BKOJK BLXMC BNPGV CAG COF CS3 DIK DM4 DU5 EBS EFBJH EFLBG EJD EO8 EO9 EP2 EP3 F5P FDB FEDTE FGOYB FIRID FNPLU FYGXN G-Q G8K GBLVA GBOLZ HVGLF HZ~ IHE IXB J1W KOM LCYCR LG5 M41 MO0 N9A NCXOZ O-L O9- OAUVE OK1 OZT P-8 P-9 PC. Q38 R2- RIG ROL RPZ SDF SDG SDP SES SEW SPC SPCBC SSH SSV SSZ T5K UAP UHS UNMZH XPP ZGI ZMT ZU3 ~G- 0SF AAXKI ADVLN AFJKZ AKRWK CGR CUY CVF ECM EIF NPM AAYXX CITATION 7X8 5PM |
ID | FETCH-LOGICAL-c451t-a1baa04325a35098389abd895027661053d6359f224ccc78ae59a4e6d830f0313 |
IEDL.DBID | AIKHN |
ISSN | 1532-0464 |
IngestDate | Tue Sep 17 21:32:05 EDT 2024 Sat Oct 05 06:12:02 EDT 2024 Thu Sep 26 15:56:09 EDT 2024 Sat Sep 28 08:15:37 EDT 2024 Fri Feb 23 02:38:28 EST 2024 |
IsDoiOpenAccess | true |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Keywords | Evaluation framework Human factors engineering Health technology assessment Clinical decision support Implementation science Health information technology |
Language | English |
License | This is an open access article under the CC BY license. Copyright © 2022 The Author(s). Published by Elsevier Inc. All rights reserved. |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c451t-a1baa04325a35098389abd895027661053d6359f224ccc78ae59a4e6d830f0313 |
Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-3 content type line 23 ObjectType-Review-2 AUTHOR CONTRIBUTIONS Polina V. Kukhareva: Conceptualization, Methodology, Formal analysis, Investigation, Data Curation, Writing - Original Draft, Writing - Review & Editing, Visualization, Project administration. Charlene Weir: Methodology, Formal analysis, Investigation, Writing - Review & Editing, Supervision. Guilherme Del Fiol: Methodology, Formal analysis, Investigation, Writing - Review & Editing, Supervision. Gregory A. Aarons: Writing - Review & Editing. Teresa Y. Taft: Formal analysis, Writing - Review & Editing. Chelsey R. Schlechter: Formal analysis, Writing - Review & Editing. Thomas J. Reese: Writing - Review & Editing. Rebecca L. Curran: Writing - Review & Editing. Claude Nanjo: Formal analysis, Writing - Review & Editing. Damian Borbolla: Writing - Review & Editing. Catherine J Staes: Writing - Review & Editing. Keaton L. Morgan, MD, MS: Writing - Review & Editing. Heidi S. Kramer: Writing - Review & Editing. Carole H. Stipelman: Formal analysis, Writing - Review & Editing. Julie H. Shakib: Formal analysis, Writing - Review & Editing. Michael C. Flynn: Writing - Review & Editing. Kensaku Kawamoto: Methodology, Formal analysis, Investigation, Supervision, Funding acquisition. |
OpenAccessLink | https://www.sciencedirect.com/science/article/pii/S1532046422000302 |
PMID | 35167977 |
PQID | 2629386409 |
PQPubID | 23479 |
PageCount | 1 |
ParticipantIDs | pubmedcentral_primary_oai_pubmedcentral_nih_gov_8959015 proquest_miscellaneous_2629386409 crossref_primary_10_1016_j_jbi_2022_104014 pubmed_primary_35167977 elsevier_sciencedirect_doi_10_1016_j_jbi_2022_104014 |
PublicationCentury | 2000 |
PublicationDate | 2022-03-01 |
PublicationDateYYYYMMDD | 2022-03-01 |
PublicationDate_xml | – month: 03 year: 2022 text: 2022-03-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | United States |
PublicationPlace_xml | – name: United States |
PublicationTitle | Journal of biomedical informatics |
PublicationTitleAlternate | J Biomed Inform |
PublicationYear | 2022 |
Publisher | Elsevier Inc |
Publisher_xml | – name: Elsevier Inc |
References | Kawamoto, Kukhareva, Weir (b0200) 2021; 4 Greenhalgh, Wherton, Papoutsi, Lynch, Hughes, A'Court, Hinder, Fahy, Procter, Shaw (b0335) 2017; 19 Lengnick-Hall, Stadnick, Dickson, Moullin, Aarons (b0470) 2021; 16 Sloman, Fernbach (b0050) 2017 Edholm, Kukhareva, Ciarkowski, Carr, Gill, Rupp, Morshedzadeh, Werner, Kawamoto (b0205) 2018 Horton, Graves, Kukhareva (b0210) 2020 Jones, Rudin, Perry, Shekelle (b0535) 2014; 160 Yarbrough, Kukhareva, Horton, Edholm, Kawamoto (b0220) 2016; 11 Pinnock, Barwick, Carpenter (b0340) 2017; 356 Stead, Haynes, Fuller, Friedman, Travis, Beck, Fenichel, Chandrasekaran, Buchanan, Abola, Sievert, Gardner, Messerle, Jaffe, Pearson, Abarbanel (b0025) 1994; 1 ReImagine EHR Initiative Products, University of Utah, Published 2020. Accessed March 17, 2020. reimagineehr.utah.edu. Haynes, del Fiol, Michelson, Iorio (b0360) 2020; 172 Zhang, Norman (b0415) 1994; 18 Stirman, Baumann, Miller (b0150) 2019; 14 Begg, Cho, Eastwood (b0300) 1996; 276 . J. Brooke, A “quick and dirty” usability scale, in: P.W. Jordan, B. Thomas, B.A. Weerdmeester, I.L. McClelland (Eds.), Usability Evaluation in Industry, first ed., Taylor & Francis, 1996, pp. 189–195. Nykänen, Brender, Talmon, de Keizer, Rigby, Beuscart-Zephir, Ammenwerth (b0105) 2011; 80 Drummond, Sculpher, Claxton, Stoddart, Torrance (b0280) 2015 Ammenwerth, Brender, Nykänen, Prokosch, Rigby, Talmon (b0030) 2004; 73 Koppel, Metlay, Cohen (b0020) 2005; 293 Mandl, Gottlieb, Ellis (b0180) 2019; 21 EPIS Framework, Accessed March 19, 2021. Wong, Otles, Donnelly, Krumm, McCullough, DeTroyer-Cooley, Pestrue, Phillips, Konye, Penoza, Ghous, Singh (b0015) 2021; 181 Kidholm, Ekeland, Jensen, Rasmussen, Pedersen, Bowes, Flottorp, Bech (b0100) 2012; 28 Ranade-Kharkar, Narus, Anderson, Conway, Del Fiol (b0440) 2018; 85 Neame, Sefton, Roberts, Harkness, Sinha, Hawcutt (b0085) 2020; 142 Godinho, Ansari, Guo, Liaw (b0065) 2021 Coiera, Westbrook, Wyatt (b0290) 2006 Johnson, Johnson, Zhang (b0115) 2005; 38 Luce, Drummond, Jönsson, Neumann, Schwartz, Siebert, Sullivan (b0275) 2010; 88 Trinkley, Kahn, Bennett, Glasgow, Haugen, Kao, Kroehl, Lin, Malone, Matlock (b0355) 2020; 22 Curran, Kukhareva, Taft (b0250) 2020; 27 Murray, Hekler, Andersson, Collins, Doherty, Hollis, Rivera, West, Wyatt (b0045) 2016; 51 Talmon, Ammenwerth, Brender, de Keizer, Nykänen, Rigby (b0310) 2009; 78 Jaspers, Steen, Van Den, Geenen (b0480) 2004; 73 Vis, Bührmann, Riper, Ossebaard (b0070) 2020; 36 American Academy of Pediatrics Subcommittee on Hyperbilirubinemia (b0460) 2004; 114 Tougas, Hayden, McGrath, Huguet, Rozario, Courvoisier (b0365) 2015; 10 Kushniruk, Beuscart-Zéphir, Grzes, Borycki, Watbled, Kannry (b0285) 2010; 13 J. Nielsen, 10 Heuristics for User Interface Design, Nielsen Norman Group, Published 1994. Accessed February 12, 2020. Fast Healthcare Interoperability Resources (FHIR) standard, Health Level Seven International (HL7), Accessed September 23, 2019. CMS | Physician Fee Schedule, Accessed February 26, 2021. Proctor, Silmere, Raghavan, Hovmand, Aarons, Bunger, Griffey, Hensley (b0330) 2011; 38 Westbrook, Braithwaite, Iedema, Coiera (b0395) 2004; 11 Yusof, Kuljis, Papazafeiropoulou, Stergioulas (b0055) 2008; 77 Kowatsch, Otto, Harperink, Cotti, Schlieter (b0130) 2019; 61 Reese, Schlechter, Kramer (b0255) 2021 Currie (b0060) 2005; 74 Y. Park, G.P. Jackson, M.A. Foreman, D. Gruen, J. Hu, A.K. Das, Evaluating Artificial Intelligence in Medicine: Phases of Clinical Research, Vol 3. Oxford University Press, 2020, pp. 326–331. Accessed April 20, 2021. /pmc/articles/PMC7660958/. Bates, Kuperman, Wang, Gandhi, Kittler, Volk, Spurr, Khorasani, Tanasijevic, Middleton (b0475) 2003; 10 M.R. Endsley, D.J. Garland (Eds.), Situation Awareness Analysis and Measurement. Lawrence Erlbaum Associates, Inc, 2000. von Thiele Schwarz, Aarons, Hasson (b0495) 2019; 19 Chang, Kuzniewicz, McCulloch, Newman (b0530) 2017; 139 Zhang, Walji (b0110) 2011; 44 Kawamoto, McDonald (b0040) 2020; 172 Price, Lau (b0125) 2014; 14 Moullin, Dickson, Stadnick, Rabin, Aarons (b0160) 2019; 14 T. Taft, C. Staes, S. Slager, C. Weir, Adapting Nielsen’s Design Heuristics to Dual Processing for Clinical Decision Support, in: AMIA: Annu Symp proceedings AMIA Symp 2016, 2016, pp. 1179–1188. Accessed October 7, 2020. /pmc/articles/PMC5333283/?report=abstract. Mandel, Kreda, Mandl, Kohane, Ramoni (b0190) 2016; 23 Brender (b0165) 2006 Damschroder, Aron, Keith, Kirsh, Alexander, Lowery (b0155) 2009; 4 Saldana, Chamberlain, Bradford, Campbell, Landsverk (b0500) 2014; 39 Patel, Arocha, Diermeier, Greenes, Shortliffe (b0380) 2001; 34 Kawamoto, Martin, Williams (b0520) 2014; 22 Wright, Sittig (b0120) 2008; 41 Abedin, Hoerner, Habboushe, Lu, Kawamoto, Warner, Shields, Shah (b0260) 2020; 13 Yusof, Papazafeiropoulou, Paul, Stergioulas (b0080) 2008; 77 McCoy, Thomas, Krousel-Wood, Sittig (b0430) 2014; 14 SMART App Gallery: Intermountain Healthcare Bilirubin Chart, Accessed April 22, 2021. Ciarkowski, Timbrook, Kukhareva (b0230) 2020 Wright, Ai, Ash (b0510) 2018; 25 ONC’s Cures Act Final Rule, Published 2020, Accessed September 23, 2020. J. Camacho, M. Zanoletti-Mannello, Z. Landis-Lewis, et al., A Conceptual Framework to Study the Implementation of Clinical Decision Support Systems (BEAR): Literature Review and Concept Mapping, vol 22, JMIR Publications, 2020, p. e18388. doi Melnick, Sinsky, Krumholz (b0505) 2021; 325 Edholm, Lappé, Kukhareva, Hopkins, Hatton, Gebhart, Nyman, Signor, Davis, Kawamoto, Johnson (b0225) 2020; 42 W.H. DeLone, E.R. McLean, The DeLone and McLean model of information systems success: A ten-year update, Journal of Management Information Systems, vol 19, M.E. Sharpe Inc., 2003, pp. 9–30. Kawamoto, Kukhareva, Shakib, Kramer, Rodriguez, Warner, Shields, Weir, Del Fiol, Taft, Stipelman (b0235) 2019; 2 Christopoulou, Kotsilieris, Anagnostopoulos (b0270) 2018; 6 Larson, Harvey, Rubin, Irani, Tse, Langlotz (b0135) 2021; 18 Mathews, McShea, Hanley, Ravitz, Labrique, Cohen (b0145) 2019; 2 Ammenwerth, Gräber, Herrmann, Bürkle, König (b0465) 2003; 71 Sockolow, Crawford, Lehmann (b0095) 2012; 51 Soares, Schilling (b0445) 2020 J. Fox, R. Thomson, Clinical decision support systems: a discussion of quality, safety and legal liability issues, in: Proc AMIA Symp., Published online 2002, pp. 265–269. Accessed October 8, 2020. Published 2019. Accessed September 23, 2020. Kaplan (b0385) 2001; 64 Kushniruk, Patel (b0410) 2004; 37 P.S. Sockolow, K.H. Bowles, M. Rogers, Health Information Technology Evaluation Framework (HITREF) Comprehensiveness as Assessed in Electronic Point-of-Care Documentation Systems Evaluations, in: Studies in Health Technology and Informatics. Vol 216. IOS Press, 2015, pp. 406–409. doi Hart, Staveland (b0490) 1988; 52 Aarons, Hurlburt, Horwitz (b0035) 2011; 38 Venkatesh, Morris, Davis, Davis (b0375) 2003; 27 Glasgow, Vogt, Boles (b0325) 1999; 89 Tarumi, Takeuchi, Chalkidis, Rodriguez-Loya, Kuwata, Flynn, Turner, Sakaguchi, Weir, Kramer, Shields, Warner, Kukhareva, Ban, Kawamoto (b0245) 2021; 60 F. Schulte, E. Fry, Death by a thousand clicks: where electronic health records went wrong, Kaiser Health News. Bauer, Damschroder, Hagedorn, Smith, Kilbourne (b0320) 2015; 3 Ruparelia (b0450) 2010; 35 Schloemer, Schröder-Bäck (b0345) 2018; 13 Husereau, Drummond, Petrou, Carswell, Moher, Greenberg, Augustovski, Briggs, Mauskopf, Loder (b0315) 2013; 16 Magrabi, Ammenwerth, Hyppönen, de Keizer, Nykänen, Rigby, Scott, Talmon, Georgiou (b0295) 2016; 25 Unertl, Abraham, Bakken (b0390) 2021; 28 Eslami Andargoli, Scheepers, Rajendran, Sohal (b0075) 2017; 97 Yarbrough, Kukhareva, Spivak, Hopkins, Kawamoto (b0215) 2015; 10 Proctor, Powell, McMillen (b0170) 2013; 8 Kukhareva, Warner, Rodriguez (b0240) 2019 Holtzblatt, Wendell, Wood (b0400) 2004 Mandl, Mandel, Kohane (b0005) 2015; 1 Crandall, Klein, Hoffman (b0405) 2006 Ogrinc, Davies, Goodman, Batalden, Davidoff, Stevens (b0305) 2016; 25 10.1016/j.jbi.2022.104014_b0515 Yusof (10.1016/j.jbi.2022.104014_b0055) 2008; 77 10.1016/j.jbi.2022.104014_b0350 Haynes (10.1016/j.jbi.2022.104014_b0360) 2020; 172 Trinkley (10.1016/j.jbi.2022.104014_b0355) 2020; 22 10.1016/j.jbi.2022.104014_b0195 Greenhalgh (10.1016/j.jbi.2022.104014_b0335) 2017; 19 Kawamoto (10.1016/j.jbi.2022.104014_b0235) 2019; 2 Kawamoto (10.1016/j.jbi.2022.104014_b0520) 2014; 22 Ammenwerth (10.1016/j.jbi.2022.104014_b0465) 2003; 71 Kidholm (10.1016/j.jbi.2022.104014_b0100) 2012; 28 Vis (10.1016/j.jbi.2022.104014_b0070) 2020; 36 Schloemer (10.1016/j.jbi.2022.104014_b0345) 2018; 13 Murray (10.1016/j.jbi.2022.104014_b0045) 2016; 51 Pinnock (10.1016/j.jbi.2022.104014_b0340) 2017; 356 Talmon (10.1016/j.jbi.2022.104014_b0310) 2009; 78 Zhang (10.1016/j.jbi.2022.104014_b0110) 2011; 44 Wong (10.1016/j.jbi.2022.104014_b0015) 2021; 181 10.1016/j.jbi.2022.104014_b0525 Zhang (10.1016/j.jbi.2022.104014_b0415) 1994; 18 Horton (10.1016/j.jbi.2022.104014_b0210) 2020 Ogrinc (10.1016/j.jbi.2022.104014_b0305) 2016; 25 10.1016/j.jbi.2022.104014_b0485 Kowatsch (10.1016/j.jbi.2022.104014_b0130) 2019; 61 Stead (10.1016/j.jbi.2022.104014_b0025) 1994; 1 Reese (10.1016/j.jbi.2022.104014_b0255) 2021 Soares (10.1016/j.jbi.2022.104014_b0445) 2020 Ammenwerth (10.1016/j.jbi.2022.104014_b0030) 2004; 73 Damschroder (10.1016/j.jbi.2022.104014_b0155) 2009; 4 Lengnick-Hall (10.1016/j.jbi.2022.104014_b0470) 2021; 16 American Academy of Pediatrics Subcommittee on Hyperbilirubinemia (10.1016/j.jbi.2022.104014_b0460) 2004; 114 Wright (10.1016/j.jbi.2022.104014_b0120) 2008; 41 Christopoulou (10.1016/j.jbi.2022.104014_b0270) 2018; 6 10.1016/j.jbi.2022.104014_b0455 Stirman (10.1016/j.jbi.2022.104014_b0150) 2019; 14 10.1016/j.jbi.2022.104014_b0175 Unertl (10.1016/j.jbi.2022.104014_b0390) 2021; 28 Melnick (10.1016/j.jbi.2022.104014_b0505) 2021; 325 Kawamoto (10.1016/j.jbi.2022.104014_b0040) 2020; 172 Yarbrough (10.1016/j.jbi.2022.104014_b0215) 2015; 10 Coiera (10.1016/j.jbi.2022.104014_b0290) 2006 Hart (10.1016/j.jbi.2022.104014_b0490) 1988; 52 Proctor (10.1016/j.jbi.2022.104014_b0330) 2011; 38 Ruparelia (10.1016/j.jbi.2022.104014_b0450) 2010; 35 Venkatesh (10.1016/j.jbi.2022.104014_b0375) 2003; 27 Westbrook (10.1016/j.jbi.2022.104014_b0395) 2004; 11 Begg (10.1016/j.jbi.2022.104014_b0300) 1996; 276 10.1016/j.jbi.2022.104014_b0185 Drummond (10.1016/j.jbi.2022.104014_b0280) 2015 Glasgow (10.1016/j.jbi.2022.104014_b0325) 1999; 89 Abedin (10.1016/j.jbi.2022.104014_b0260) 2020; 13 Holtzblatt (10.1016/j.jbi.2022.104014_b0400) 2004 Tarumi (10.1016/j.jbi.2022.104014_b0245) 2021; 60 Tougas (10.1016/j.jbi.2022.104014_b0365) 2015; 10 Yusof (10.1016/j.jbi.2022.104014_b0080) 2008; 77 Neame (10.1016/j.jbi.2022.104014_b0085) 2020; 142 10.1016/j.jbi.2022.104014_b0435 Jaspers (10.1016/j.jbi.2022.104014_b0480) 2004; 73 Moullin (10.1016/j.jbi.2022.104014_b0160) 2019; 14 Kushniruk (10.1016/j.jbi.2022.104014_b0285) 2010; 13 Mandel (10.1016/j.jbi.2022.104014_b0190) 2016; 23 Husereau (10.1016/j.jbi.2022.104014_b0315) 2013; 16 Sockolow (10.1016/j.jbi.2022.104014_b0095) 2012; 51 Edholm (10.1016/j.jbi.2022.104014_b0205) 2018 Chang (10.1016/j.jbi.2022.104014_b0530) 2017; 139 Ciarkowski (10.1016/j.jbi.2022.104014_b0230) 2020 Yarbrough (10.1016/j.jbi.2022.104014_b0220) 2016; 11 von Thiele Schwarz (10.1016/j.jbi.2022.104014_b0495) 2019; 19 Crandall (10.1016/j.jbi.2022.104014_b0405) 2006 Johnson (10.1016/j.jbi.2022.104014_b0115) 2005; 38 Jones (10.1016/j.jbi.2022.104014_b0535) 2014; 160 Edholm (10.1016/j.jbi.2022.104014_b0225) 2020; 42 Mandl (10.1016/j.jbi.2022.104014_b0005) 2015; 1 Godinho (10.1016/j.jbi.2022.104014_b0065) 2021 Saldana (10.1016/j.jbi.2022.104014_b0500) 2014; 39 Ranade-Kharkar (10.1016/j.jbi.2022.104014_b0440) 2018; 85 Eslami Andargoli (10.1016/j.jbi.2022.104014_b0075) 2017; 97 Sloman (10.1016/j.jbi.2022.104014_b0050) 2017 Kushniruk (10.1016/j.jbi.2022.104014_b0410) 2004; 37 Wright (10.1016/j.jbi.2022.104014_b0510) 2018; 25 Price (10.1016/j.jbi.2022.104014_b0125) 2014; 14 Brender (10.1016/j.jbi.2022.104014_b0165) 2006 10.1016/j.jbi.2022.104014_b0010 Mandl (10.1016/j.jbi.2022.104014_b0180) 2019; 21 Kawamoto (10.1016/j.jbi.2022.104014_b0200) 2021; 4 10.1016/j.jbi.2022.104014_b0370 10.1016/j.jbi.2022.104014_b0090 McCoy (10.1016/j.jbi.2022.104014_b0430) 2014; 14 Koppel (10.1016/j.jbi.2022.104014_b0020) 2005; 293 Currie (10.1016/j.jbi.2022.104014_b0060) 2005; 74 Bauer (10.1016/j.jbi.2022.104014_b0320) 2015; 3 Mathews (10.1016/j.jbi.2022.104014_b0145) 2019; 2 Kaplan (10.1016/j.jbi.2022.104014_b0385) 2001; 64 10.1016/j.jbi.2022.104014_b0425 Patel (10.1016/j.jbi.2022.104014_b0380) 2001; 34 Bates (10.1016/j.jbi.2022.104014_b0475) 2003; 10 Larson (10.1016/j.jbi.2022.104014_b0135) 2021; 18 Curran (10.1016/j.jbi.2022.104014_b0250) 2020; 27 Nykänen (10.1016/j.jbi.2022.104014_b0105) 2011; 80 10.1016/j.jbi.2022.104014_b0140 10.1016/j.jbi.2022.104014_b0420 10.1016/j.jbi.2022.104014_b0265 Magrabi (10.1016/j.jbi.2022.104014_b0295) 2016; 25 Proctor (10.1016/j.jbi.2022.104014_b0170) 2013; 8 Kukhareva (10.1016/j.jbi.2022.104014_b0240) 2019 Luce (10.1016/j.jbi.2022.104014_b0275) 2010; 88 Aarons (10.1016/j.jbi.2022.104014_b0035) 2011; 38 |
References_xml | – volume: 139 year: 2017 ident: b0530 article-title: A clinical prediction rule for rebound hyperbilirubinemia following inpatient phototherapy publication-title: Pediatrics contributor: fullname: Newman – volume: 25 start-page: 61 year: 2016 end-page: 69 ident: b0295 article-title: Improving Evaluation to Address the Unintended Consequences of Health Information Technology: a Position Paper from the Working Group on Technology Assessment & Quality Development publication-title: Yearb. Med. Inform. contributor: fullname: Georgiou – volume: 38 start-page: 65 year: 2011 end-page: 76 ident: b0330 article-title: Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda publication-title: Adm. Policy Ment. Heal. Ment. Heal. Serv. Res. contributor: fullname: Hensley – volume: 1 start-page: 8 year: 2015 end-page: 13 ident: b0005 article-title: Driving innovation in health systems through an apps-based information economy publication-title: Cell Syst. contributor: fullname: Kohane – year: 2021 ident: b0255 article-title: Implementing lung cancer screening in primary care: needs assessment and implementation strategy design publication-title: Transl. Behav Med. contributor: fullname: Kramer – volume: 10 start-page: 523 year: 2003 end-page: 530 ident: b0475 article-title: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Middleton – volume: 181 start-page: 1065 year: 2021 ident: b0015 article-title: External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients publication-title: JAMA Intern. Med. contributor: fullname: Singh – volume: 61 start-page: 253 year: 2019 end-page: 263 ident: b0130 article-title: A design and evaluation framework for digital health interventions publication-title: IT – Inf. Technol. contributor: fullname: Schlieter – volume: 293 start-page: 1197 year: 2005 end-page: 1203 ident: b0020 article-title: Role of computerized physician order entry systems in facilitating medication errors publication-title: J. Am. Med. Assoc. contributor: fullname: Cohen – start-page: 846 year: 2020 end-page: 847 ident: b0445 article-title: Is my SMART on FHIR app ready for prime time? A review guideline for building and evaluating apps from proof of concept to production publication-title: AMIA Informatics Summit contributor: fullname: Schilling – volume: 97 start-page: 195 year: 2017 end-page: 209 ident: b0075 article-title: Health information systems evaluation frameworks: A systematic review publication-title: Int. J. Med. Inform. contributor: fullname: Sohal – volume: 18 start-page: 413 year: 2021 end-page: 424 ident: b0135 article-title: Regulatory Frameworks for Development and Evaluation of Artificial Intelligence-Based Diagnostic Imaging Algorithms: Summary and Recommendations publication-title: J. Am. Coll. Radiol. contributor: fullname: Langlotz – start-page: 562 year: 2019 end-page: 571 ident: b0240 article-title: Balancing Functionality versus Portability for SMART on FHIR Applications: Case Study for a Neonatal Bilirubin Management Application publication-title: AMIA Annu. Symp. Proc. contributor: fullname: Rodriguez – volume: 25 start-page: 986 year: 2016 end-page: 992 ident: b0305 article-title: Standards for quality improvement reporting excellence (SQUIRE 2.0) publication guidelines publication-title: BMJ Qual. Saf. contributor: fullname: Stevens – volume: 172 start-page: 101 year: 2020 end-page: 109 ident: b0040 article-title: Designing, Conducting, and Reporting Clinical Decision Support Studies: Recommendations and Call to Action publication-title: Ann. Intern. Med. contributor: fullname: McDonald – volume: 78 start-page: 1 year: 2009 end-page: 9 ident: b0310 article-title: STARE-HI-Statement on reporting of evaluation studies in Health Informatics publication-title: Int. J. Med. Inform. contributor: fullname: Rigby – volume: 27 start-page: 425 year: 2003 end-page: 478 ident: b0375 article-title: User Acceptance of Information Technology: Toward a Unified View publication-title: MIS Q contributor: fullname: Davis – year: 2020 ident: b0230 article-title: A Pathway for Community-Acquired Pneumonia with Rapid Conversion to Oral Therapy Improves Healthcare Value publication-title: Open Forum Infect. Dis. contributor: fullname: Kukhareva – volume: 73 start-page: 781 year: 2004 end-page: 795 ident: b0480 article-title: The think aloud method: A guide to user interface design publication-title: Int. J. Med. Inform. contributor: fullname: Geenen – volume: 18 start-page: 87 year: 1994 end-page: 122 ident: b0415 article-title: Representations in distributed cognitive tasks publication-title: Cogn. Sci. contributor: fullname: Norman – volume: 2 start-page: e1915343 year: 2019 ident: b0235 article-title: Association of an electronic health record add-on app for neonatal bilirubin management with physician efficiency and care quality publication-title: JAMA Netw. Open. contributor: fullname: Stipelman – volume: 28 start-page: 197 year: 2021 end-page: 208 ident: b0390 article-title: Building on Diana Forsythe’s legacy: the value of human experience and context in biomedical and health informatics publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Bakken – volume: 51 start-page: 843 year: 2016 end-page: 851 ident: b0045 article-title: Evaluating Digital Health Interventions: Key Questions and Approaches publication-title: Am. J. Prev. Med. contributor: fullname: Wyatt – volume: 13 year: 2018 ident: b0345 article-title: Criteria for evaluating transferability of health interventions: A systematic review and thematic synthesis publication-title: Implement Sci. contributor: fullname: Schröder-Bäck – volume: 4 start-page: 50 year: 2009 ident: b0155 article-title: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science publication-title: Implement Sci. contributor: fullname: Lowery – volume: 71 start-page: 125 year: 2003 end-page: 135 ident: b0465 article-title: Evaluation of health information systems—problems and challenges publication-title: Int. J. Med. Inform. contributor: fullname: König – volume: 14 start-page: 195 year: 2014 end-page: 202 ident: b0430 article-title: Clinical decision support alert appropriateness: a review and proposal for improvement publication-title: Ochsner J. contributor: fullname: Sittig – volume: 16 start-page: 34 year: 2021 ident: b0470 article-title: Forms and functions of bridging factors: specifying the dynamic links between outer and inner contexts during implementation and sustainment publication-title: Implement Sci. contributor: fullname: Aarons – volume: 38 start-page: 4 year: 2011 end-page: 23 ident: b0035 article-title: Advancing a conceptual model of evidence-based practice implementation in public service sectors publication-title: Adm. Policy Ment. Heal. Ment. Heal. Serv. Res. contributor: fullname: Horwitz – volume: 77 start-page: 386 year: 2008 end-page: 398 ident: b0055 article-title: An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit) publication-title: Int. J. Med. Inform. contributor: fullname: Stergioulas – volume: 13 start-page: 53 year: 2010 end-page: 58 ident: b0285 article-title: Increasing the Safety of Healthcare Information Systems through Improved Procurement: Toward a Framework for Selection of Safe Healthcare Systems publication-title: hcq contributor: fullname: Kannry – volume: 60 start-page: e32 year: 2021 end-page: e43 ident: b0245 article-title: Leveraging Artificial Intelligence to Improve Chronic Disease Care: Methods and Application to Pharmacotherapy Decision Support for Type-2 Diabetes Mellitus publication-title: Methods Inf. Med. contributor: fullname: Kawamoto – volume: 23 start-page: 1 year: 2016 end-page: 10 ident: b0190 article-title: SMART on FHIR: A standards-based, interoperable apps platform for electronic health records publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Ramoni – volume: 276 start-page: 637 year: 1996 end-page: 639 ident: b0300 article-title: Improving the quality of reporting of randomized controlled trials: The CONSORT statement publication-title: J. Am. Med. Assoc. contributor: fullname: Eastwood – volume: 34 start-page: 52 year: 2001 end-page: 66 ident: b0380 article-title: Methods of cognitive analysis to support the design and evaluation of biomedical systems: The case of clinical practice guidelines publication-title: J. Biomed. Inform. contributor: fullname: Shortliffe – volume: 356 year: 2017 ident: b0340 article-title: Standards for Reporting Implementation Studies (StaRI) Statement publication-title: BMJ contributor: fullname: Carpenter – year: 2006 ident: b0165 article-title: Handbook of Evaluation Methods for Health Informatics contributor: fullname: Brender – volume: 42 start-page: e66 year: 2020 end-page: e74 ident: b0225 article-title: Reducing Diabetic Ketoacidosis Intensive Care Unit Admissions Through an Electronic Health Record-Driven, Standardized Care Pathway publication-title: J. Healthc. Qual. contributor: fullname: Johnson – volume: 73 start-page: 479 year: 2004 end-page: 491 ident: b0030 article-title: Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck publication-title: Int. J. Med. Inform. contributor: fullname: Talmon – volume: 85 start-page: 1 year: 2018 end-page: 9 ident: b0440 article-title: Data standards for interoperability of care team information to support care coordination of complex pediatric patients publication-title: J. Biomed. Inform. contributor: fullname: Del Fiol – volume: 44 start-page: 1056 year: 2011 end-page: 1067 ident: b0110 article-title: TURF: Toward a unified framework of EHR usability publication-title: J. Biomed. Inform. contributor: fullname: Walji – volume: 172 start-page: S73 year: 2020 end-page: S78 ident: b0360 article-title: Context and Approach in Reporting Evaluations of Electronic Health Record-Based Implementation Projects publication-title: Ann. Intern. Med. contributor: fullname: Iorio – volume: 25 start-page: 496 year: 2018 end-page: 506 ident: b0510 article-title: Clinical decision support alert malfunctions: analysis and empirically derived taxonomy publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Ash – volume: 41 start-page: 982 year: 2008 end-page: 990 ident: b0120 article-title: A framework and model for evaluating clinical decision support architectures publication-title: J. Biomed. Inform. contributor: fullname: Sittig – year: 2017 ident: b0050 article-title: The Knowledge Illusion: Why We Never Think Alone contributor: fullname: Fernbach – start-page: 20 year: 2006 end-page: 25 ident: b0290 article-title: The safety and quality of decision support systems publication-title: Yearb. Med. Inform. contributor: fullname: Wyatt – year: 2020 ident: b0210 article-title: Modified early warning score-based clinical decision support: cost impact and clinical outcomes in sepsis publication-title: JAMIA Open contributor: fullname: Kukhareva – volume: 28 start-page: 44 year: 2012 end-page: 51 ident: b0100 article-title: A model for assessment of telemedicine applications: Mast publication-title: Int. J. Technol. Assess. Health Care contributor: fullname: Bech – volume: 16 start-page: 231 year: 2013 end-page: 250 ident: b0315 article-title: Consolidated health economic evaluation reporting standards (CHEERS)-explanation and elaboration: A report of the ISPOR health economic evaluation publication guidelines good reporting practices task force publication-title: Value Heal. contributor: fullname: Loder – volume: 37 start-page: 56 year: 2004 end-page: 76 ident: b0410 article-title: Cognitive and Usability Engineering Methods for the Evaluation of Clinical Information Systems publication-title: J. Biomed. Inform. contributor: fullname: Patel – volume: 38 start-page: 75 year: 2005 end-page: 87 ident: b0115 article-title: A user-centered framework for redesigning health care interfaces publication-title: J. Biomed. Inform. contributor: fullname: Zhang – volume: 6 start-page: 109 year: 2018 ident: b0270 article-title: Assessment of Health Information Technology Interventions in Evidence-Based Medicine: A Systematic Review by Adopting a Methodological Evaluation Framework publication-title: Healthcare contributor: fullname: Anagnostopoulos – volume: 88 start-page: 256 year: 2010 end-page: 276 ident: b0275 article-title: EBM, HTA, and CER: Clearing the confusion publication-title: Milbank Q contributor: fullname: Sullivan – year: 2015 ident: b0280 article-title: Methods for the Economic Evaluation of Health Care Programmes contributor: fullname: Torrance – volume: 8 start-page: 139 year: 2013 ident: b0170 article-title: Implementation strategies: Recommendations for specifying and reporting publication-title: Implement Sci. contributor: fullname: McMillen – volume: 64 start-page: 39 year: 2001 end-page: 56 ident: b0385 article-title: Evaluating informatics applications - Some alternative approaches: Theory, social interactionism, and call for methodological pluralism publication-title: Int. J. Med. Inform. contributor: fullname: Kaplan – year: 2004 ident: b0400 article-title: Rapid Contextual Design contributor: fullname: Wood – volume: 52 start-page: 139 year: 1988 end-page: 183 ident: b0490 article-title: Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research publication-title: Adv. Psychol. contributor: fullname: Staveland – volume: 19 year: 2019 ident: b0495 article-title: The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation publication-title: BMC Health Serv. Res contributor: fullname: Hasson – volume: 35 start-page: 8 year: 2010 end-page: 13 ident: b0450 article-title: Software development lifecycle models publication-title: ACM SIGSOFT Softw. Eng. Notes contributor: fullname: Ruparelia – volume: 22 start-page: 223 year: 2014 end-page: 235 ident: b0520 article-title: Value Driven Outcomes (VDO): a pragmatic, modular, and extensible software framework for understanding and improving health care costs and outcomes publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Williams – volume: 14 start-page: 58 year: 2019 ident: b0150 article-title: The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions publication-title: Implement Sci. contributor: fullname: Miller – volume: 74 start-page: 908 year: 2005 end-page: 916 ident: b0060 article-title: Evaluation frameworks for nursing informatics publication-title: Int. J. Med. Inform. contributor: fullname: Currie – year: 2021 ident: b0065 article-title: Toolkits for implementing and evaluating digital health: A systematic review of rigor and reporting publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Liaw – volume: 22 start-page: e19676 year: 2020 ident: b0355 article-title: Integrating the Practical Robust Implementation and Sustainability Model With Best Practices in Clinical Decision Support Design: Implementation Science Approach publication-title: J. Med. Internet Res. contributor: fullname: Matlock – volume: 10 start-page: e0134977 year: 2015 ident: b0365 article-title: A systematic review exploring the social cognitive theory of self-regulation as a framework for chronic health condition interventions publication-title: PLoS ONE contributor: fullname: Courvoisier – volume: 142 start-page: 104247 year: 2020 ident: b0085 article-title: Evaluating health information technologies: A systematic review of framework recommendations publication-title: Int. J. Med. Inform. contributor: fullname: Hawcutt – volume: 19 start-page: e367 year: 2017 ident: b0335 article-title: Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies publication-title: J. Med. Internet Res. contributor: fullname: Shaw – volume: 80 start-page: 815 year: 2011 end-page: 827 ident: b0105 article-title: Guideline for good evaluation practice in health informatics (GEP-HI) publication-title: Int. J. Med. Inform. contributor: fullname: Ammenwerth – volume: 14 start-page: 1 year: 2014 end-page: 10 ident: b0125 article-title: The clinical adoption meta-model: A temporal meta-model describing the clinical adoption of health information systems publication-title: BMC Med. Inf. Decis. Making contributor: fullname: Lau – volume: 2 start-page: 1 year: 2019 end-page: 9 ident: b0145 article-title: Digital health: a path to validation publication-title: npj Digit Med. contributor: fullname: Cohen – volume: 4 start-page: 1 year: 2021 end-page: 15 ident: b0200 article-title: Establishing a multidisciplinary initiative for interoperable electronic health record innovations at an academic medical center publication-title: JAMIA Open contributor: fullname: Weir – volume: 325 start-page: 2149 year: 2021 ident: b0505 article-title: Implementing Measurement Science for Electronic Health Record Use publication-title: JAMA – J. Am. Med. Assoc. contributor: fullname: Krumholz – volume: 13 year: 2020 ident: b0260 article-title: Implementation of a Fast Healthcare Interoperability Resources-Based Clinical Decision Support Tool for Calculating CHA2DS2-VASc Scores publication-title: Circ. Cardiovasc. Qual. Outcomes contributor: fullname: Shah – volume: 114 start-page: 1138 year: 2004 ident: b0460 article-title: Management of hyperbilirubinemia in the newborn infant 35 or more weeks of gestation publication-title: Pediatrics contributor: fullname: American Academy of Pediatrics Subcommittee on Hyperbilirubinemia – volume: 51 start-page: 122 year: 2012 end-page: 130 ident: b0095 article-title: Health services research evaluation principles: Broadening a general framework for evaluating health information technology publication-title: Methods Inf. Med. contributor: fullname: Lehmann – year: 2018 ident: b0205 article-title: Decrease in inpatient telemetry utilization through a system-wide electronic health record change and a multifaceted hospitalist intervention publication-title: J. Hosp. Med. contributor: fullname: Kawamoto – year: 2006 ident: b0405 article-title: Working Minds. A Practitioner’s Guide to Cognitive Task Analysis contributor: fullname: Hoffman – volume: 36 start-page: 204 year: 2020 end-page: 216 ident: b0070 article-title: Health technology assessment frameworks for eHealth: A systematic review publication-title: Int. J. Technol. Assess. Health Care contributor: fullname: Ossebaard – volume: 77 start-page: 377 year: 2008 end-page: 385 ident: b0080 article-title: Investigating evaluation frameworks for health information systems publication-title: Int. J. Med. Inform. contributor: fullname: Stergioulas – volume: 21 year: 2019 ident: b0180 article-title: Beyond One-Off Integrations: A Commercial, Substitutable, Reusable, Standards-Based, Electronic Health Record-Connected App publication-title: J. Med Internet Res. contributor: fullname: Ellis – volume: 39 start-page: 177 year: 2014 end-page: 182 ident: b0500 article-title: The cost of implementing new strategies (COINS): A method for mapping implementation resources using the stages of implementation completion publication-title: Child Youth Serv. Rev. contributor: fullname: Landsverk – volume: 160 start-page: 48 year: 2014 end-page: 54 ident: b0535 article-title: Health information technology: An updated systematic review with a focus on meaningful use publication-title: Ann. Intern. Med. contributor: fullname: Shekelle – volume: 11 start-page: 348 year: 2016 end-page: 354 ident: b0220 article-title: Multifaceted intervention including education, rounding checklist implementation, cost feedback, and financial incentives reduces inpatient laboratory costs publication-title: J. Hosp. Med. contributor: fullname: Kawamoto – volume: 14 year: 2019 ident: b0160 article-title: Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework publication-title: Implement Sci. contributor: fullname: Aarons – volume: 11 start-page: 1323 year: 2004 end-page: 1327 ident: b0395 article-title: Evaluating the impact of information communication technologies on complex organizational systems: a multi-disciplinary, multi-method framework publication-title: Medinfo. contributor: fullname: Coiera – volume: 1 start-page: 28 year: 1994 end-page: 33 ident: b0025 article-title: Designing medical informatics research and library-resource projects to increase what is learned publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Abarbanel – volume: 27 start-page: 1225 year: 2020 end-page: 1234 ident: b0250 article-title: Integrated displays to improve chronic disease management in ambulatory care: A SMART on FHIR application informed by mixed-methods user testing publication-title: J. Am. Med. Inform. Assoc. contributor: fullname: Taft – volume: 3 start-page: 32 year: 2015 ident: b0320 article-title: An introduction to implementation science for the non-specialist publication-title: BMC Psychol. contributor: fullname: Kilbourne – volume: 10 start-page: 780 year: 2015 end-page: 786 ident: b0215 article-title: Evidence-based care pathway for cellulitis improves process, clinical, and cost outcomes publication-title: J. Hosp. Med. contributor: fullname: Kawamoto – volume: 89 start-page: 1322 year: 1999 end-page: 1327 ident: b0325 article-title: Evaluating the public health impact of health promotion interventions: the RE-AIM framework publication-title: Am. J. Public Health contributor: fullname: Boles – volume: 37 start-page: 56 issue: 1 year: 2004 ident: 10.1016/j.jbi.2022.104014_b0410 article-title: Cognitive and Usability Engineering Methods for the Evaluation of Clinical Information Systems publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2004.01.003 contributor: fullname: Kushniruk – volume: 276 start-page: 637 issue: 8 year: 1996 ident: 10.1016/j.jbi.2022.104014_b0300 article-title: Improving the quality of reporting of randomized controlled trials: The CONSORT statement publication-title: J. Am. Med. Assoc. doi: 10.1001/jama.1996.03540080059030 contributor: fullname: Begg – volume: 11 start-page: 1323 issue: Pt 2 year: 2004 ident: 10.1016/j.jbi.2022.104014_b0395 article-title: Evaluating the impact of information communication technologies on complex organizational systems: a multi-disciplinary, multi-method framework publication-title: Medinfo. contributor: fullname: Westbrook – volume: 142 start-page: 104247 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0085 article-title: Evaluating health information technologies: A systematic review of framework recommendations publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2020.104247 contributor: fullname: Neame – volume: 97 start-page: 195 year: 2017 ident: 10.1016/j.jbi.2022.104014_b0075 article-title: Health information systems evaluation frameworks: A systematic review publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2016.10.008 contributor: fullname: Eslami Andargoli – volume: 23 start-page: 1 issue: 5 year: 2016 ident: 10.1016/j.jbi.2022.104014_b0190 article-title: SMART on FHIR: A standards-based, interoperable apps platform for electronic health records publication-title: J. Am. Med. Inform. Assoc. doi: 10.1093/jamia/ocv189 contributor: fullname: Mandel – volume: 89 start-page: 1322 issue: 9 year: 1999 ident: 10.1016/j.jbi.2022.104014_b0325 article-title: Evaluating the public health impact of health promotion interventions: the RE-AIM framework publication-title: Am. J. Public Health doi: 10.2105/AJPH.89.9.1322 contributor: fullname: Glasgow – volume: 4 start-page: 1 issue: 3 year: 2021 ident: 10.1016/j.jbi.2022.104014_b0200 article-title: Establishing a multidisciplinary initiative for interoperable electronic health record innovations at an academic medical center publication-title: JAMIA Open doi: 10.1093/jamiaopen/ooab041 contributor: fullname: Kawamoto – ident: 10.1016/j.jbi.2022.104014_b0485 – volume: 13 start-page: 53 issue: sp year: 2010 ident: 10.1016/j.jbi.2022.104014_b0285 article-title: Increasing the Safety of Healthcare Information Systems through Improved Procurement: Toward a Framework for Selection of Safe Healthcare Systems publication-title: hcq doi: 10.12927/hcq.2010.21967 contributor: fullname: Kushniruk – volume: 77 start-page: 386 issue: 6 year: 2008 ident: 10.1016/j.jbi.2022.104014_b0055 article-title: An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit) publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2007.08.011 contributor: fullname: Yusof – volume: 74 start-page: 908 issue: 11–12 year: 2005 ident: 10.1016/j.jbi.2022.104014_b0060 article-title: Evaluation frameworks for nursing informatics publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2005.07.007 contributor: fullname: Currie – volume: 71 start-page: 125 issue: 2-3 year: 2003 ident: 10.1016/j.jbi.2022.104014_b0465 article-title: Evaluation of health information systems—problems and challenges publication-title: Int. J. Med. Inform. doi: 10.1016/S1386-5056(03)00131-X contributor: fullname: Ammenwerth – year: 2006 ident: 10.1016/j.jbi.2022.104014_b0165 contributor: fullname: Brender – volume: 13 issue: 2 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0260 article-title: Implementation of a Fast Healthcare Interoperability Resources-Based Clinical Decision Support Tool for Calculating CHA2DS2-VASc Scores publication-title: Circ. Cardiovasc. Qual. Outcomes doi: 10.1161/CIRCOUTCOMES.119.006286 contributor: fullname: Abedin – ident: 10.1016/j.jbi.2022.104014_b0090 – volume: 4 start-page: 50 issue: 1 year: 2009 ident: 10.1016/j.jbi.2022.104014_b0155 article-title: Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science publication-title: Implement Sci. doi: 10.1186/1748-5908-4-50 contributor: fullname: Damschroder – volume: 14 issue: 1 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0160 article-title: Systematic review of the Exploration, Preparation, Implementation, Sustainment (EPIS) framework publication-title: Implement Sci. doi: 10.1186/s13012-018-0842-6 contributor: fullname: Moullin – volume: 51 start-page: 122 issue: 2 year: 2012 ident: 10.1016/j.jbi.2022.104014_b0095 article-title: Health services research evaluation principles: Broadening a general framework for evaluating health information technology publication-title: Methods Inf. Med. doi: 10.3414/ME10-01-0066 contributor: fullname: Sockolow – ident: 10.1016/j.jbi.2022.104014_b0455 doi: 10.1080/07421222.2003.11045748 – ident: 10.1016/j.jbi.2022.104014_b0525 – volume: 10 start-page: e0134977 issue: 8 year: 2015 ident: 10.1016/j.jbi.2022.104014_b0365 article-title: A systematic review exploring the social cognitive theory of self-regulation as a framework for chronic health condition interventions publication-title: PLoS ONE doi: 10.1371/journal.pone.0134977 contributor: fullname: Tougas – volume: 172 start-page: S73 issue: 11_Supplement year: 2020 ident: 10.1016/j.jbi.2022.104014_b0360 article-title: Context and Approach in Reporting Evaluations of Electronic Health Record-Based Implementation Projects publication-title: Ann. Intern. Med. doi: 10.7326/M19-0874 contributor: fullname: Haynes – start-page: 846 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0445 article-title: Is my SMART on FHIR app ready for prime time? A review guideline for building and evaluating apps from proof of concept to production contributor: fullname: Soares – volume: 21 issue: 2 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0180 article-title: Beyond One-Off Integrations: A Commercial, Substitutable, Reusable, Standards-Based, Electronic Health Record-Connected App publication-title: J. Med Internet Res. doi: 10.2196/12902 contributor: fullname: Mandl – volume: 325 start-page: 2149 issue: 21 year: 2021 ident: 10.1016/j.jbi.2022.104014_b0505 article-title: Implementing Measurement Science for Electronic Health Record Use publication-title: JAMA – J. Am. Med. Assoc. doi: 10.1001/jama.2021.5487 contributor: fullname: Melnick – volume: 80 start-page: 815 issue: 12 year: 2011 ident: 10.1016/j.jbi.2022.104014_b0105 article-title: Guideline for good evaluation practice in health informatics (GEP-HI) publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2011.08.004 contributor: fullname: Nykänen – volume: 1 start-page: 8 issue: 1 year: 2015 ident: 10.1016/j.jbi.2022.104014_b0005 article-title: Driving innovation in health systems through an apps-based information economy publication-title: Cell Syst. doi: 10.1016/j.cels.2015.05.001 contributor: fullname: Mandl – volume: 14 start-page: 1 issue: 1 year: 2014 ident: 10.1016/j.jbi.2022.104014_b0125 article-title: The clinical adoption meta-model: A temporal meta-model describing the clinical adoption of health information systems publication-title: BMC Med. Inf. Decis. Making contributor: fullname: Price – volume: 18 start-page: 413 issue: 3 year: 2021 ident: 10.1016/j.jbi.2022.104014_b0135 article-title: Regulatory Frameworks for Development and Evaluation of Artificial Intelligence-Based Diagnostic Imaging Algorithms: Summary and Recommendations publication-title: J. Am. Coll. Radiol. doi: 10.1016/j.jacr.2020.09.060 contributor: fullname: Larson – volume: 10 start-page: 780 issue: 12 year: 2015 ident: 10.1016/j.jbi.2022.104014_b0215 article-title: Evidence-based care pathway for cellulitis improves process, clinical, and cost outcomes publication-title: J. Hosp. Med. doi: 10.1002/jhm.2433 contributor: fullname: Yarbrough – volume: 25 start-page: 986 year: 2016 ident: 10.1016/j.jbi.2022.104014_b0305 article-title: Standards for quality improvement reporting excellence (SQUIRE 2.0) publication guidelines publication-title: BMJ Qual. Saf. doi: 10.1136/bmjqs-2015-004411 contributor: fullname: Ogrinc – year: 2020 ident: 10.1016/j.jbi.2022.104014_b0230 article-title: A Pathway for Community-Acquired Pneumonia with Rapid Conversion to Oral Therapy Improves Healthcare Value publication-title: Open Forum Infect. Dis. doi: 10.1093/ofid/ofaa497 contributor: fullname: Ciarkowski – volume: 52 start-page: 139 issue: C year: 1988 ident: 10.1016/j.jbi.2022.104014_b0490 article-title: Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research publication-title: Adv. Psychol. doi: 10.1016/S0166-4115(08)62386-9 contributor: fullname: Hart – ident: 10.1016/j.jbi.2022.104014_b0175 – ident: 10.1016/j.jbi.2022.104014_b0425 – ident: 10.1016/j.jbi.2022.104014_b0140 doi: 10.1093/jamiaopen/ooaa033 – volume: 114 start-page: 1138 issue: 4 year: 2004 ident: 10.1016/j.jbi.2022.104014_b0460 article-title: Management of hyperbilirubinemia in the newborn infant 35 or more weeks of gestation publication-title: Pediatrics contributor: fullname: American Academy of Pediatrics Subcommittee on Hyperbilirubinemia – volume: 8 start-page: 139 issue: 1 year: 2013 ident: 10.1016/j.jbi.2022.104014_b0170 article-title: Implementation strategies: Recommendations for specifying and reporting publication-title: Implement Sci. doi: 10.1186/1748-5908-8-139 contributor: fullname: Proctor – volume: 19 issue: 1 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0495 article-title: The Value Equation: Three complementary propositions for reconciling fidelity and adaptation in evidence-based practice implementation publication-title: BMC Health Serv. Res doi: 10.1186/s12913-019-4668-y contributor: fullname: von Thiele Schwarz – volume: 18 start-page: 87 issue: 1 year: 1994 ident: 10.1016/j.jbi.2022.104014_b0415 article-title: Representations in distributed cognitive tasks publication-title: Cogn. Sci. doi: 10.1207/s15516709cog1801_3 contributor: fullname: Zhang – volume: 78 start-page: 1 issue: 1 year: 2009 ident: 10.1016/j.jbi.2022.104014_b0310 article-title: STARE-HI-Statement on reporting of evaluation studies in Health Informatics publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2008.09.002 contributor: fullname: Talmon – ident: 10.1016/j.jbi.2022.104014_b0350 doi: 10.2196/18388 – ident: 10.1016/j.jbi.2022.104014_b0195 – volume: 22 start-page: e19676 issue: 10 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0355 article-title: Integrating the Practical Robust Implementation and Sustainability Model With Best Practices in Clinical Decision Support Design: Implementation Science Approach publication-title: J. Med. Internet Res. doi: 10.2196/19676 contributor: fullname: Trinkley – volume: 64 start-page: 39 issue: 1 year: 2001 ident: 10.1016/j.jbi.2022.104014_b0385 article-title: Evaluating informatics applications - Some alternative approaches: Theory, social interactionism, and call for methodological pluralism publication-title: Int. J. Med. Inform. doi: 10.1016/S1386-5056(01)00184-8 contributor: fullname: Kaplan – ident: 10.1016/j.jbi.2022.104014_b0420 – year: 2020 ident: 10.1016/j.jbi.2022.104014_b0210 article-title: Modified early warning score-based clinical decision support: cost impact and clinical outcomes in sepsis publication-title: JAMIA Open doi: 10.1093/jamiaopen/ooaa014 contributor: fullname: Horton – volume: 38 start-page: 4 issue: 1 year: 2011 ident: 10.1016/j.jbi.2022.104014_b0035 article-title: Advancing a conceptual model of evidence-based practice implementation in public service sectors publication-title: Adm. Policy Ment. Heal. Ment. Heal. Serv. Res. doi: 10.1007/s10488-010-0327-7 contributor: fullname: Aarons – year: 2004 ident: 10.1016/j.jbi.2022.104014_b0400 contributor: fullname: Holtzblatt – volume: 61 start-page: 253 issue: 5–6 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0130 article-title: A design and evaluation framework for digital health interventions publication-title: IT – Inf. Technol. contributor: fullname: Kowatsch – volume: 22 start-page: 223 issue: 1 year: 2014 ident: 10.1016/j.jbi.2022.104014_b0520 article-title: Value Driven Outcomes (VDO): a pragmatic, modular, and extensible software framework for understanding and improving health care costs and outcomes publication-title: J. Am. Med. Inform. Assoc. doi: 10.1136/amiajnl-2013-002511 contributor: fullname: Kawamoto – volume: 39 start-page: 177 year: 2014 ident: 10.1016/j.jbi.2022.104014_b0500 article-title: The cost of implementing new strategies (COINS): A method for mapping implementation resources using the stages of implementation completion publication-title: Child Youth Serv. Rev. doi: 10.1016/j.childyouth.2013.10.006 contributor: fullname: Saldana – volume: 139 issue: 3 year: 2017 ident: 10.1016/j.jbi.2022.104014_b0530 article-title: A clinical prediction rule for rebound hyperbilirubinemia following inpatient phototherapy publication-title: Pediatrics doi: 10.1542/peds.2016-2896 contributor: fullname: Chang – volume: 293 start-page: 1197 issue: 10 year: 2005 ident: 10.1016/j.jbi.2022.104014_b0020 article-title: Role of computerized physician order entry systems in facilitating medication errors publication-title: J. Am. Med. Assoc. doi: 10.1001/jama.293.10.1197 contributor: fullname: Koppel – volume: 160 start-page: 48 issue: 1 year: 2014 ident: 10.1016/j.jbi.2022.104014_b0535 article-title: Health information technology: An updated systematic review with a focus on meaningful use publication-title: Ann. Intern. Med. doi: 10.7326/M13-1531 contributor: fullname: Jones – volume: 11 start-page: 348 issue: 5 year: 2016 ident: 10.1016/j.jbi.2022.104014_b0220 article-title: Multifaceted intervention including education, rounding checklist implementation, cost feedback, and financial incentives reduces inpatient laboratory costs publication-title: J. Hosp. Med. doi: 10.1002/jhm.2552 contributor: fullname: Yarbrough – volume: 356 year: 2017 ident: 10.1016/j.jbi.2022.104014_b0340 article-title: Standards for Reporting Implementation Studies (StaRI) Statement publication-title: BMJ contributor: fullname: Pinnock – volume: 1 start-page: 28 issue: 1 year: 1994 ident: 10.1016/j.jbi.2022.104014_b0025 article-title: Designing medical informatics research and library-resource projects to increase what is learned publication-title: J. Am. Med. Inform. Assoc. doi: 10.1136/jamia.1994.95236134 contributor: fullname: Stead – volume: 27 start-page: 425 issue: 3 year: 2003 ident: 10.1016/j.jbi.2022.104014_b0375 article-title: User Acceptance of Information Technology: Toward a Unified View publication-title: MIS Q doi: 10.2307/30036540 contributor: fullname: Venkatesh – volume: 77 start-page: 377 issue: 6 year: 2008 ident: 10.1016/j.jbi.2022.104014_b0080 article-title: Investigating evaluation frameworks for health information systems publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2007.08.004 contributor: fullname: Yusof – volume: 13 issue: 1 year: 2018 ident: 10.1016/j.jbi.2022.104014_b0345 article-title: Criteria for evaluating transferability of health interventions: A systematic review and thematic synthesis publication-title: Implement Sci. doi: 10.1186/s13012-018-0751-8 contributor: fullname: Schloemer – volume: 172 start-page: 101 issue: 11 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0040 article-title: Designing, Conducting, and Reporting Clinical Decision Support Studies: Recommendations and Call to Action publication-title: Ann. Intern. Med. doi: 10.7326/M19-0875 contributor: fullname: Kawamoto – volume: 2 start-page: 1 issue: 1 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0145 article-title: Digital health: a path to validation publication-title: npj Digit Med. contributor: fullname: Mathews – volume: 27 start-page: 1225 issue: 8 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0250 article-title: Integrated displays to improve chronic disease management in ambulatory care: A SMART on FHIR application informed by mixed-methods user testing publication-title: J. Am. Med. Inform. Assoc. doi: 10.1093/jamia/ocaa099 contributor: fullname: Curran – volume: 51 start-page: 843 issue: 5 year: 2016 ident: 10.1016/j.jbi.2022.104014_b0045 article-title: Evaluating Digital Health Interventions: Key Questions and Approaches publication-title: Am. J. Prev. Med. doi: 10.1016/j.amepre.2016.06.008 contributor: fullname: Murray – ident: 10.1016/j.jbi.2022.104014_b0370 doi: 10.1201/b12461 – volume: 16 start-page: 231 issue: 2 year: 2013 ident: 10.1016/j.jbi.2022.104014_b0315 article-title: Consolidated health economic evaluation reporting standards (CHEERS)-explanation and elaboration: A report of the ISPOR health economic evaluation publication guidelines good reporting practices task force publication-title: Value Heal. doi: 10.1016/j.jval.2013.02.002 contributor: fullname: Husereau – year: 2021 ident: 10.1016/j.jbi.2022.104014_b0065 article-title: Toolkits for implementing and evaluating digital health: A systematic review of rigor and reporting publication-title: J. Am. Med. Inform. Assoc. doi: 10.1093/jamia/ocab010 contributor: fullname: Godinho – volume: 44 start-page: 1056 issue: 6 year: 2011 ident: 10.1016/j.jbi.2022.104014_b0110 article-title: TURF: Toward a unified framework of EHR usability publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2011.08.005 contributor: fullname: Zhang – volume: 60 start-page: e32 issue: S 01 year: 2021 ident: 10.1016/j.jbi.2022.104014_b0245 article-title: Leveraging Artificial Intelligence to Improve Chronic Disease Care: Methods and Application to Pharmacotherapy Decision Support for Type-2 Diabetes Mellitus publication-title: Methods Inf. Med. doi: 10.1055/s-0041-1728757 contributor: fullname: Tarumi – volume: 6 start-page: 109 issue: 3 year: 2018 ident: 10.1016/j.jbi.2022.104014_b0270 article-title: Assessment of Health Information Technology Interventions in Evidence-Based Medicine: A Systematic Review by Adopting a Methodological Evaluation Framework publication-title: Healthcare doi: 10.3390/healthcare6030109 contributor: fullname: Christopoulou – volume: 41 start-page: 982 issue: 6 year: 2008 ident: 10.1016/j.jbi.2022.104014_b0120 article-title: A framework and model for evaluating clinical decision support architectures publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2008.03.009 contributor: fullname: Wright – volume: 14 start-page: 195 issue: 2 year: 2014 ident: 10.1016/j.jbi.2022.104014_b0430 article-title: Clinical decision support alert appropriateness: a review and proposal for improvement publication-title: Ochsner J. contributor: fullname: McCoy – year: 2015 ident: 10.1016/j.jbi.2022.104014_b0280 contributor: fullname: Drummond – volume: 25 start-page: 61 issue: 01 year: 2016 ident: 10.1016/j.jbi.2022.104014_b0295 article-title: Improving Evaluation to Address the Unintended Consequences of Health Information Technology: a Position Paper from the Working Group on Technology Assessment & Quality Development publication-title: Yearb. Med. Inform. doi: 10.15265/IY-2016-013 contributor: fullname: Magrabi – year: 2018 ident: 10.1016/j.jbi.2022.104014_b0205 article-title: Decrease in inpatient telemetry utilization through a system-wide electronic health record change and a multifaceted hospitalist intervention publication-title: J. Hosp. Med. contributor: fullname: Edholm – volume: 28 start-page: 44 issue: 1 year: 2012 ident: 10.1016/j.jbi.2022.104014_b0100 article-title: A model for assessment of telemedicine applications: Mast publication-title: Int. J. Technol. Assess. Health Care doi: 10.1017/S0266462311000638 contributor: fullname: Kidholm – volume: 25 start-page: 496 issue: 5 year: 2018 ident: 10.1016/j.jbi.2022.104014_b0510 article-title: Clinical decision support alert malfunctions: analysis and empirically derived taxonomy publication-title: J. Am. Med. Inform. Assoc. doi: 10.1093/jamia/ocx106 contributor: fullname: Wright – volume: 42 start-page: e66 issue: 5 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0225 article-title: Reducing Diabetic Ketoacidosis Intensive Care Unit Admissions Through an Electronic Health Record-Driven, Standardized Care Pathway publication-title: J. Healthc. Qual. doi: 10.1097/JHQ.0000000000000247 contributor: fullname: Edholm – start-page: 20 year: 2006 ident: 10.1016/j.jbi.2022.104014_b0290 article-title: The safety and quality of decision support systems publication-title: Yearb. Med. Inform. contributor: fullname: Coiera – ident: 10.1016/j.jbi.2022.104014_b0010 – ident: 10.1016/j.jbi.2022.104014_b0515 – volume: 16 start-page: 34 issue: 1 year: 2021 ident: 10.1016/j.jbi.2022.104014_b0470 article-title: Forms and functions of bridging factors: specifying the dynamic links between outer and inner contexts during implementation and sustainment publication-title: Implement Sci. doi: 10.1186/s13012-021-01099-y contributor: fullname: Lengnick-Hall – volume: 85 start-page: 1 year: 2018 ident: 10.1016/j.jbi.2022.104014_b0440 article-title: Data standards for interoperability of care team information to support care coordination of complex pediatric patients publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2018.07.009 contributor: fullname: Ranade-Kharkar – volume: 34 start-page: 52 issue: 1 year: 2001 ident: 10.1016/j.jbi.2022.104014_b0380 article-title: Methods of cognitive analysis to support the design and evaluation of biomedical systems: The case of clinical practice guidelines publication-title: J. Biomed. Inform. doi: 10.1006/jbin.2001.1002 contributor: fullname: Patel – volume: 10 start-page: 523 issue: 6 year: 2003 ident: 10.1016/j.jbi.2022.104014_b0475 article-title: Ten Commandments for Effective Clinical Decision Support: Making the Practice of Evidence-based Medicine a Reality publication-title: J. Am. Med. Inform. Assoc. doi: 10.1197/jamia.M1370 contributor: fullname: Bates – year: 2017 ident: 10.1016/j.jbi.2022.104014_b0050 contributor: fullname: Sloman – volume: 73 start-page: 781 issue: 11–12 year: 2004 ident: 10.1016/j.jbi.2022.104014_b0480 article-title: The think aloud method: A guide to user interface design publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2004.08.003 contributor: fullname: Jaspers – volume: 181 start-page: 1065 issue: 8 year: 2021 ident: 10.1016/j.jbi.2022.104014_b0015 article-title: External Validation of a Widely Implemented Proprietary Sepsis Prediction Model in Hospitalized Patients publication-title: JAMA Intern. Med. doi: 10.1001/jamainternmed.2021.2626 contributor: fullname: Wong – ident: 10.1016/j.jbi.2022.104014_b0265 – volume: 73 start-page: 479 issue: 6 year: 2004 ident: 10.1016/j.jbi.2022.104014_b0030 article-title: Visions and strategies to improve evaluation of health information systems: Reflections and lessons based on the HIS-EVAL workshop in Innsbruck publication-title: Int. J. Med. Inform. doi: 10.1016/j.ijmedinf.2004.04.004 contributor: fullname: Ammenwerth – volume: 14 start-page: 58 issue: 1 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0150 article-title: The FRAME: An expanded framework for reporting adaptations and modifications to evidence-based interventions publication-title: Implement Sci. doi: 10.1186/s13012-019-0898-y contributor: fullname: Stirman – ident: 10.1016/j.jbi.2022.104014_b0185 – volume: 88 start-page: 256 issue: 2 year: 2010 ident: 10.1016/j.jbi.2022.104014_b0275 article-title: EBM, HTA, and CER: Clearing the confusion publication-title: Milbank Q doi: 10.1111/j.1468-0009.2010.00598.x contributor: fullname: Luce – year: 2021 ident: 10.1016/j.jbi.2022.104014_b0255 article-title: Implementing lung cancer screening in primary care: needs assessment and implementation strategy design publication-title: Transl. Behav Med. contributor: fullname: Reese – volume: 36 start-page: 204 issue: 3 year: 2020 ident: 10.1016/j.jbi.2022.104014_b0070 article-title: Health technology assessment frameworks for eHealth: A systematic review publication-title: Int. J. Technol. Assess. Health Care doi: 10.1017/S026646232000015X contributor: fullname: Vis – volume: 2 start-page: e1915343 issue: 11 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0235 article-title: Association of an electronic health record add-on app for neonatal bilirubin management with physician efficiency and care quality publication-title: JAMA Netw. Open. doi: 10.1001/jamanetworkopen.2019.15343 contributor: fullname: Kawamoto – start-page: 562 year: 2019 ident: 10.1016/j.jbi.2022.104014_b0240 article-title: Balancing Functionality versus Portability for SMART on FHIR Applications: Case Study for a Neonatal Bilirubin Management Application publication-title: AMIA Annu. Symp. Proc. contributor: fullname: Kukhareva – year: 2006 ident: 10.1016/j.jbi.2022.104014_b0405 contributor: fullname: Crandall – volume: 38 start-page: 75 issue: 1 year: 2005 ident: 10.1016/j.jbi.2022.104014_b0115 article-title: A user-centered framework for redesigning health care interfaces publication-title: J. Biomed. Inform. doi: 10.1016/j.jbi.2004.11.005 contributor: fullname: Johnson – volume: 28 start-page: 197 issue: 2 year: 2021 ident: 10.1016/j.jbi.2022.104014_b0390 article-title: Building on Diana Forsythe’s legacy: the value of human experience and context in biomedical and health informatics publication-title: J. Am. Med. Inform. Assoc. doi: 10.1093/jamia/ocaa337 contributor: fullname: Unertl – ident: 10.1016/j.jbi.2022.104014_b0435 – volume: 3 start-page: 32 issue: 1 year: 2015 ident: 10.1016/j.jbi.2022.104014_b0320 article-title: An introduction to implementation science for the non-specialist publication-title: BMC Psychol. doi: 10.1186/s40359-015-0089-9 contributor: fullname: Bauer – volume: 38 start-page: 65 issue: 2 year: 2011 ident: 10.1016/j.jbi.2022.104014_b0330 article-title: Outcomes for implementation research: Conceptual distinctions, measurement challenges, and research agenda publication-title: Adm. Policy Ment. Heal. Ment. Heal. Serv. Res. doi: 10.1007/s10488-010-0319-7 contributor: fullname: Proctor – volume: 35 start-page: 8 issue: 3 year: 2010 ident: 10.1016/j.jbi.2022.104014_b0450 article-title: Software development lifecycle models publication-title: ACM SIGSOFT Softw. Eng. Notes doi: 10.1145/1764810.1764814 contributor: fullname: Ruparelia – volume: 19 start-page: e367 issue: 11 year: 2017 ident: 10.1016/j.jbi.2022.104014_b0335 article-title: Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies publication-title: J. Med. Internet Res. doi: 10.2196/jmir.8775 contributor: fullname: Greenhalgh |
SSID | ssj0011556 |
Score | 2.4108274 |
SecondaryResourceType | review_article |
Snippet | [Display omitted]
•It is critical for EHR-integrated innovations to be systematically evaluated.•Effective evaluation of EHR-integrated innovations requires a... Our objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at each of four... OBJECTIVEOur objective was to develop an evaluation framework for electronic health record (EHR)-integrated innovations to support evaluation activities at... |
SourceID | pubmedcentral proquest crossref pubmed elsevier |
SourceType | Open Access Repository Aggregation Database Index Database Publisher |
StartPage | 104014 |
SubjectTerms | Clinical decision support Commerce Electronic Health Records Evaluation framework Health information technology Health technology assessment Human factors engineering Humans Implementation science Information Technology Medical Informatics Technology |
Title | Evaluation in Life Cycle of Information Technology (ELICIT) framework: Supporting the innovation life cycle from business case assessment to summative evaluation |
URI | https://dx.doi.org/10.1016/j.jbi.2022.104014 https://www.ncbi.nlm.nih.gov/pubmed/35167977 https://search.proquest.com/docview/2629386409 https://pubmed.ncbi.nlm.nih.gov/PMC8959015 |
Volume | 127 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lb9NAEB6VVEKgqoLwCoVokDgAkht7s7t2uLVRqoSGXmhRbtbaXoMrZFc0PfTCf-GfMuO13QYEB45-rVae3Zlvdma-AXhtfRXlydj3JiokB0Vl2iNUn3jMdeLbNNM6qRNkT_T8TH5YqdUWTNtaGE6rbHS_0-m1tm7ujJq_ObooitGngHsaSMLPogb2pIe3yRxJ2YPtg8Xx_KQLJpDJ1I42VXAmo2yDm3Wa13lSkJcoBAc7_UD-zTz9CT9_z6K8ZZaOHsBugyfxwE35IWzZsg_3b7EM9uHuxyZ-3ocdd0qHrvjoEfycdWTfWJS4LHKL02saCKscm0ql-uHNCTy-mS0X08XpW8zbvK73yL1BK-Yj-IIEKGmottUqfuMh03pIrmTBpunlJaZkPtF0vKC4rrAupGP1izcc5I_h7Gh2Op17TdMGL5UqWHsmSIxhnj9lxgRGIgJEJsmiiSL_l7AA7fmMMM4kJ-iQpmkYGasmRlqdRWM_ZyLJJ9Arq9I-A8xCJRKrdSrYj4uEiaxRXHlAMFELqwbwrpVVfOG4OeI2ae08JsHGLNjYCXYAspVmvLHAYrId__rsVSv5mDYeR1NMaaury1hoQkqRJv94AE_dSuhmQZPUISHrAYQba6R7gUm9N5-Uxdea3Jv-FEO05_833T24x1cuSe4F9Nbfr-xLQk3rZAh39n8EQ9obh5-Pl8Nmj9DdxerwF67PGVg |
link.rule.ids | 230,315,786,790,891,3525,4521,24144,27600,27955,27956,45618,45696,45712,45907 |
linkProvider | Elsevier |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV3fb9MwED5NQ-KHEILCoBuDQ-IBkKKmbuykvLGqU7t1e6GT-mY5iQOZUDKx7oE_h_-UOzvJVqbxwGucWFbOvvvOd_cdwHsbyqRIR2EwljE5KDJXAaH6NGCuk9BmuVKpS5A9VbOz6GglV1swaWthOK2y0f1epztt3TwZNH9zcFGWg69D7mkQEX4WDtiTHr4XSfL1uIpvddCFEshgKk-aKjiPMWpDmy7J6zwtyUcUgkOd4TC6yzjdBp9_51DeMEqHT-FJgybxi1_wM9iyVQ8e3eAY7MH9kyZ63oPH_o4OfenRc_g97ai-saxwURYWJ79oIqwLbOqU3OD1_Tt-mC7mk_nyIxZtVtdn5M6gNbMRfEOCkzRV22gVf_CUmZuS61iwaXl5iRkZTzQdKyiua3RldKx88ZqB_AWcHU6Xk1nQtGwIskgO14EZpsYwy580I4IiCcEhk-bJWJL3S0iATnxOCGdcEHDIsixOjJVjE1mVJ6OwYBrJHdiu6sq-AsxjKVKrVCbYi0uESayRXHdAIFEJK_vwqZWVvvDMHLpNWTvXJFjNgtVesH2IWmnqje2lyXL867N3reQ1HTuOpZjK1leXWijCSYki77gPL_1O6FZBi1Qx4eo-xBt7pHuBKb03R6ryu6P2pj_FAG33_5b7Fh7MlicLvZifHu_BQx7x6XKvYXv988ruE35ap2_c-fgD9i4Xow |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Evaluation+in+Life+Cycle+of+Information+Technology+%28ELICIT%29+Framework%3A+Supporting+the+Innovation+Life+Cycle+from+Business+Case+Assessment+to+Summative+Evaluation&rft.jtitle=Journal+of+biomedical+informatics&rft.au=Kukhareva%2C+Polina+V.&rft.au=Weir%2C+Charlene&rft.au=Fiol%2C+Guilherme+Del&rft.au=Aarons%2C+Gregory+A.&rft.date=2022-03-01&rft.issn=1532-0464&rft.eissn=1532-0480&rft.volume=127&rft.spage=104014&rft.epage=104014&rft_id=info:doi/10.1016%2Fj.jbi.2022.104014&rft_id=info%3Apmid%2F35167977&rft.externalDBID=PMC8959015 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1532-0464&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1532-0464&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1532-0464&client=summon |