Method agreement analysis: A review of correct methodology

• Published in: Theriogenology Vol. 73; no. 9; pp. 1167 - 1179
• Main Authors: Watson, P.F., Petrie, A.
• Format: Journal Article
• Language: English
• Published: United States Elsevier Inc 01.06.2010; [Oxford]: Butterworth-Heinemann; [New York]: Elsevier Science
• Subjects: accuracy; Agreement analysis; animal physiology; animal reproduction; Animals; Bias; Bias (Epidemiology); data collection; equations; guidelines; literature reviews; measurement; meta-analysis; method agreement analysis; methodology; methods; reference standards; Reliability; Repeatability; Reproducibility; Reproducibility of Results; Reproduction; Research - statistics & numerical data; Sample size calculation; sampling; Sensitivity and Specificity; statistical analysis; statistics & numerical data; Statistics as Topic; Statistics as Topic - methods; Statistics as Topic - standards; validity; Agreement analysis; Repeatability; Sample size calculation; Reliability; Reproducibility
• ISSN: 0093-691X; 1879-3231; 1879-3231
• DOI: 10.1016/j.theriogenology.2010.01.003

The correct approach to analyzing method agreement is discussed. Whether we are considering agreement between two measurements on the same samples (repeatability) or two individuals using identical methodology on identical samples (reproducibility) or comparing two methods, appropriate procedures are described, and worked examples are shown. The correct approaches for both categorical and numerical variables are explained. More complex analyses involving a comparison of more than two pairs of data are mentioned and guidance for these analyses given. Simple formulae for calculating the approximate sample size needed for agreement analysis are also given. Examples of good practice from the reproduction literature are cited, and common errors of methodology are indicated.