Optimizing Diagnostic Classification Models Application Considering Real-Life Constraints

This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content...

Full description

Saved in:
Bibliographic Details
Published inJournal of educational and behavioral statistics Vol. 48; no. 6; pp. 750 - 772
Main Authors Su, Kun, Henson, Robert A.
Format Journal Article
LanguageEnglish
Published Los Angeles, CA SAGE Publications 01.12.2023
American Educational Research Association
Subjects
Classification
Middle Schools
Physics
Science Tests
Statistical Analysis
Test Items
test construction
mechanical efficiency
diagnostic classification models
application
physics education
Online AccessGet full text

Cover

More Information
Summary:This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content domains were carefully evaluated using a set of defined criteria, which are purposely defined to improve the success rate of DCM implementation. Given the domain, the Q-matrix is determined by a simulation-based approach using correct classification rates as criteria. Finally, a physics test on the final Q-matrix was developed, administered, and analyzed by the author and the subject-matter experts (SMEs).
Bibliography:ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ISSN:1076-9986
1935-1054
DOI:10.3102/10769986231159137