Tradeoffs between accuracy measures for electronic health care data algorithms

• Published in: Journal of clinical epidemiology Vol. 65; no. 3; pp. 343 - 349.e2
• Main Authors: Chubak, Jessica, Pocobelli, Gaia, Weiss, Noel S.
• Format: Journal Article
• Language: English
• Published: New York, NY Elsevier Inc 01.03.2012; Elsevier; Elsevier Limited
• Subjects: Aged; Algorithms; Bias; Biological and medical sciences; Clinical Coding; Databases, factual; Databases, Factual - standards; Databases, Factual - statistics & numerical data; Electronic Health Records; Epidemiologic Methods; Epidemiology; Female; General aspects; Health care; Health services; Health Services Research - statistics & numerical data; Humans; Internal Medicine; Medical records systems, computerized; Medical sciences; Miscellaneous; Misclassification; Public health. Hygiene; Public health. Hygiene-occupational medicine; Sensitivity and Specificity; Medical records systems, computerized; Algorithms; Misclassification; Epidemiology; Bias; Databases, factual; Medical data; computerized; Algorithm; Decision tree; Care; Accuracy; Databases; Medical records systems; Database; Medical record; Public health; Computerization; factual
• ISSN: 0895-4356; 1878-5921; 1878-5921
• DOI: 10.1016/j.jclinepi.2011.09.002

We review the uses of electronic health care data algorithms, measures of their accuracy, and reasons for prioritizing one measure of accuracy over another. We use real studies to illustrate the variety of uses of automated health care data in epidemiologic and health services research. Hypothetical examples show the impact of different types of misclassification when algorithms are used to ascertain exposure and outcome. High algorithm sensitivity is important for reducing the costs and burdens associated with the use of a more accurate measurement tool, for enhancing study inclusiveness, and for ascertaining common exposures. High specificity is important for classifying outcomes. High positive predictive value is important for identifying a cohort of persons with a condition of interest but that need not be representative of or include everyone with that condition. Finally, a high negative predictive value is important for reducing the likelihood that study subjects have an exclusionary condition. Epidemiologists must often prioritize one measure of accuracy over another when generating an algorithm for use in their study. We recommend researchers publish all tested algorithms—including those without acceptable accuracy levels—to help future studies refine and apply algorithms that are well suited to their objectives.