Script concordance tests: guidelines for construction

• Published in: BMC medical informatics and decision making Vol. 8; no. 1; p. 18
• Main Authors: Fournier, Jean Paul, Demeester, Anne, Charlin, Bernard
• Format: Journal Article
• Language: English
• Published: England BioMed Central Ltd 06.05.2008; BioMed Central; BMC
• Subjects: Analysis; Clinical Competence; Concordances; Correspondence; Data Interpretation, Statistical; Decision Making; Education; Educational Measurement - methods; Health aspects; Health Personnel - education; Humanities and Social Sciences; Humans; Judgment; Methods; Practice guidelines (Medicine); Reproducibility of Results; Scripts (Psychology); Uncertainty; France
• ISSN: 1472-6947; 1472-6947
• DOI: 10.1186/1472-6947-8-18

SCT is used to assess clinical reasoning in ambiguous or uncertain situations. It allows testing on real-life situations that are not adequately measured with current tests. It probes the multiple judgments that are made in the clinical reasoning process. Scoring reflects the degree of concordance of these judgments to those of a panel of reference experts. SCT is an item format that is gaining acceptance in education in the health professions. However, there are no detailed guidelines on item writing, test scoring or test optimization. The item format is described and the steps for preparing and administering reliable and valid SCTs are presented. SCTs probe examinees on a specific clinical reasoning task: data interpretation, a crucial step in the clinical reasoning process. It is inferred that a high degree of concordance corresponds to optimal use of information in the context of these specific tasks and therefore provides an indication of clinical reasoning quality.