Optimizing Diagnostic Classification Models Application Considering Real-Life Constraints

This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content...

Full description

Saved in:
Bibliographic Details
Published inJournal of educational and behavioral statistics Vol. 48; no. 6; pp. 750 - 772
Main Authors Su, Kun, Henson, Robert A.
Format Journal Article
LanguageEnglish
Published Los Angeles, CA SAGE Publications 01.12.2023
American Educational Research Association
Subjects
Classification
Middle Schools
Physics
Science Tests
Statistical Analysis
Test Items
test construction
mechanical efficiency
diagnostic classification models
application
physics education
Online AccessGet full text
ISSN1076-9986
1935-1054
DOI10.3102/10769986231159137

Cover

Abstract This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content domains were carefully evaluated using a set of defined criteria, which are purposely defined to improve the success rate of DCM implementation. Given the domain, the Q-matrix is determined by a simulation-based approach using correct classification rates as criteria. Finally, a physics test on the final Q-matrix was developed, administered, and analyzed by the author and the subject-matter experts (SMEs).
AbstractList This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable and then optimized steps for constructing a test blueprint for applying DCMs and a real-life example illustrating this process. The content domains were carefully evaluated using a set of defined criteria, which are purposely defined to improve the success rate of DCM implementation. Given the domain, the Q-matrix is determined by a simulation-based approach using correct classification rates as criteria. Finally, a physics test on the final Q-matrix was developed, administered, and analyzed by the author and the subject-matter experts (SMEs).
Audience Middle Schools
Junior High Schools
Secondary Education
Author Henson, Robert A.
Su, Kun
Author_xml – sequence: 1
  givenname: Kun
  orcidid: 0000-0001-8538-3079
  surname: Su
  fullname: Su, Kun
  organization: Sun Yat-Sen University
– sequence: 2
  givenname: Robert A.
  surname: Henson
  fullname: Henson, Robert A.
  organization: University of North Carolina at Greensboro
BackLink http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1401155$$DView record in ERIC
BookMark eNp1UMtKAzEUDVLBWv0AF8KA66l5TDLJstT6olIQXbgaMpmkpEyTMZku9OtNHR8LcXUv53HP5RyDkfNOA3CG4JQgiC8RLJkQnGGCEBWIlAdgjAShOYK0GKU98flecASOY9xAiAguyBi8rLrebu27devsysq187G3Kpu3MkZrrJK99S578I1uYzbruvYbmnsXbaPD3vioZZsvrdGfaB-kdX08AYdGtlGffs0JeL5ePM1v8-Xq5m4-W-YKc9bnhkMtGmxIwwWra6ooJwzBoiZKUMYZQ8w0NW24VAIaWTIma0woRQVjJUeYTMDFcLcL_nWnY19t_C64FFlhLmAJYZH6mIDzQZU-VlUX7FaGt2pxjwqYCqOJRwOvgo8xaPOjQbDaN1z9aTh5poMnyrX-Tf3f8AF8qXtO
Cites_doi 10.1177/0265532208097336
10.1177/0265532215590848
10.1080/15434300902985108
10.1007/BF02295640
10.1177/0734282915623053
10.1002/j.2333-8504.2005.tb01993.x
10.3102/1076998607309474
10.1037/1082-989X.11.3.287
10.1007/s11336-015-9460-2
10.1007/s13394-013-0090-7
10.1177/0146621604272623
10.3389/fpsyg.2022.851378
10.1177/0146621616638643
10.1080/14794802.2017.1325776
10.1177/0146621613502704
10.1007/s12564-011-9196-3
10.1016/j.stueduc.2009.10.003
10.1177/01466210122032064
10.1177/0265532214558457
10.1111/j.1745-3984.2011.00158.x
10.1080/15305058.2010.509554
10.1111/emip.12020
10.1007/s11336-008-9089-5
10.1080/15366367.2018.1435104
10.3389/fpsyg.2021.614470
10.1080/10627197.2013.761522
ContentType Journal Article
Copyright 2023 AERA
Copyright_xml – notice: 2023 AERA
DBID AAYXX
CITATION
7SW
BJH
BNH
BNI
BNJ
BNO
ERI
PET
REK
WWN
AHOVV
DOI 10.3102/10769986231159137
DatabaseName CrossRef
ERIC
ERIC (Ovid)
ERIC
ERIC
ERIC (Legacy Platform)
ERIC( SilverPlatter )
ERIC
ERIC PlusText (Legacy Platform)
Education Resources Information Center (ERIC)
ERIC
Education Research Index
DatabaseTitle CrossRef
ERIC
DatabaseTitleList
CrossRef
ERIC
Database_xml – sequence: 1
  dbid: ERI
  name: ERIC
  url: https://eric.ed.gov/
  sourceTypes: Index Database
DeliveryMethod fulltext_linktorsrc
Discipline Education
Statistics
Physics
EISSN 1935-1054
ERIC EJ1401155
EndPage 772
ExternalDocumentID EJ1401155
10_3102_10769986231159137
10.3102_10769986231159137
GroupedDBID -TM
-~X
.2G
.2L
0-V
01A
09Z
0R~
18M
1~K
29K
31S
31V
31W
31X
4.4
56W
5GY
5VS
8FI
8FJ
8FW
8R4
8R5
AAAZS
AACKU
AADIR
AADUE
AAGGD
AAGLT
AAJPV
AAKTJ
AAMFR
AANSI
AAPEO
AAQDB
AAQXI
AARIX
AATAA
AAWIL
AAWLO
ABAWP
ABAWQ
ABBHK
ABCCA
ABCJG
ABDLQ
ABEIX
ABFAN
ABFXH
ABHQH
ABIDT
ABIVO
ABJNI
ABKRH
ABLWH
ABOPQ
ABPNF
ABQKF
ABQPY
ABQXT
ABRHV
ABTDE
ABUJY
ABUWG
ABXSQ
ABYTW
ABYWD
ACAEP
ACDXX
ACFUR
ACFZE
ACGFO
ACGFS
ACHJO
ACHQT
ACJER
ACLZU
ACMTB
ACNCT
ACOFE
ACOXC
ACROE
ACRPL
ACSIQ
ACTMH
ACUFS
ACUIR
ACZOB
ADBBV
ADDLC
ADEBD
ADEIA
ADEPB
ADMHC
ADNFJ
ADNMO
ADNON
ADODI
ADPEE
ADRRZ
ADSTG
ADTOS
ADUKL
ADULT
ADYCS
AEDXQ
AEOBU
AESMA
AESZF
AEUHG
AEUPB
AEVPJ
AEWDL
AEWHI
AEXNY
AFEET
AFFNX
AFKBI
AFKRA
AFKRG
AFMOU
AFQAA
AFUIA
AFVYC
AFWMB
AGDVU
AGKLV
AGLNM
AGNHF
AGNWV
AGQPQ
AGWNL
AGWVZ
AHDMH
AHHFK
AHWHD
AIHAF
AJUZI
ALFTD
ALMA_UNASSIGNED_HOLDINGS
ALRMG
ALSLI
ANDLU
ARALO
ARTOV
ARYUH
ASPBG
AS~
ATKJL
AUTPY
AUVAJ
AVWKF
AYPQM
AZFZN
AZQEC
B8O
B8S
B8T
B8Z
BDZRT
BENPR
BMVBW
BPACV
BPHCQ
BVXVI
CAG
CBRKF
CCGJY
CCPQU
CEADM
CJNVE
COF
CS3
D-I
D0L
DD0
DD~
DG~
DOPDO
DQDLB
DSRWC
DU5
DV7
DV8
DWQXO
EBS
ECEWR
EJD
F5P
FEDTE
FHBDP
FYUFA
GENNL
GNUQQ
GROUPED_SAGE_PREMIER_JOURNAL_COLLECTION
H13
HF~
HGD
HQ6
HVGLF
HZ~
IPSME
J8X
JAAYA
JAV
JBMMH
JBZCM
JENOY
JHFFW
JKQEH
JLEZI
JLXEF
JMS
JPL
JST
M0P
M2M
N9A
O9-
P.B
P2P
PHGZM
PHGZT
PQEDU
PQQKQ
PROAC
PSYQQ
Q1R
Q2X
Q7O
Q7P
Q7X
RNS
ROL
RWL
S01
S0X
SA0
SASJQ
SAUOL
SCNPE
SFB
SFC
SFF
SFK
SFN
SFT
SFX
SGP
SGU
SGV
SHB
SHF
SHM
SQCSI
SSDHQ
TAE
TN5
UBC
UKHRP
XOL
ZPLXX
ZPPRI
~32
AAYXX
ACCVC
AJGYC
AMNSR
CITATION
7SW
AAEJI
AAPII
AJHME
AJVBE
BJH
BNH
BNI
BNJ
BNO
ERI
PET
PUEGO
REK
WWN
AHOVV
ID FETCH-LOGICAL-c286t-f80e9d2f3d896bb5c5836104b3c95686616fdb5d8ac90fa766ab2355146678123
ISSN 1076-9986
IngestDate Wed Aug 13 06:36:34 EDT 2025
Tue Sep 02 20:11:55 EDT 2025
Tue Jul 01 05:25:36 EDT 2025
Tue Jun 17 22:31:32 EDT 2025
IsDoiOpenAccess false
IsOpenAccess false
IsPeerReviewed true
IsScholarly true
Issue 6
Keywords test construction
mechanical efficiency
diagnostic classification models
application
physics education
Language English
LinkModel OpenURL
MergedId FETCHMERGED-LOGICAL-c286t-f80e9d2f3d896bb5c5836104b3c95686616fdb5d8ac90fa766ab2355146678123
Notes ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 14
ORCID 0000-0001-8538-3079
PQID 2890700491
PQPubID 6204
PageCount 23
ParticipantIDs proquest_journals_2890700491
eric_primary_EJ1401155
crossref_primary_10_3102_10769986231159137
sage_journals_10_3102_10769986231159137
ProviderPackageCode CITATION
AAYXX
PublicationCentury 2000
PublicationDate 2023-12-01
PublicationDateYYYYMMDD 2023-12-01
PublicationDate_xml – month: 12
  year: 2023
  text: 2023-12-01
  day: 01
PublicationDecade 2020
PublicationPlace Los Angeles, CA
PublicationPlace_xml – name: Los Angeles, CA
– name: Washington
PublicationTitle Journal of educational and behavioral statistics
PublicationYear 2023
Publisher SAGE Publications
American Educational Research Association
Publisher_xml – name: SAGE Publications
– name: American Educational Research Association
References bibr3-10769986231159137
Hartz S. M. (bibr7-10769986231159137) 2002
bibr111-10769986231159137
bibr19-10769986231159137
bibr13-10769986231159137
bibr16-10769986231159137
bibr6-10769986231159137
bibr9-10769986231159137
bibr21-10769986231159137
bibr11-10769986231159137
bibr5-10769986231159137
bibr15-10769986231159137
bibr2-10769986231159137
bibr113-10769986231159137
bibr119-10769986231159137
bibr8-10769986231159137
bibr18-10769986231159137
bibr22-10769986231159137
bibr12-10769986231159137
bibr118-10769986231159137
American Educational Research Association. American Psychological Association, & National Council on Measurement in Education (bibr1-10769986231159137) 2014
bibr4-10769986231159137
bibr115-10769986231159137
bibr17-10769986231159137
bibr14-10769986231159137
bibr24-10769986231159137
bibr20-10769986231159137
bibr23-10769986231159137
bibr10-10769986231159137
References_xml – ident: bibr11-10769986231159137
  doi: 10.1177/0265532208097336
– volume-title: Standards for educational and psychological testing
  year: 2014
  ident: bibr1-10769986231159137
– ident: bibr16-10769986231159137
  doi: 10.1177/0265532215590848
– ident: bibr15-10769986231159137
  doi: 10.1080/15434300902985108
– ident: bibr5-10769986231159137
  doi: 10.1007/BF02295640
– ident: bibr19-10769986231159137
  doi: 10.1177/0734282915623053
– ident: bibr24-10769986231159137
  doi: 10.1002/j.2333-8504.2005.tb01993.x
– ident: bibr4-10769986231159137
  doi: 10.3102/1076998607309474
– ident: bibr22-10769986231159137
  doi: 10.1037/1082-989X.11.3.287
– ident: bibr113-10769986231159137
  doi: 10.1007/s11336-015-9460-2
– ident: bibr23-10769986231159137
  doi: 10.1007/s13394-013-0090-7
– ident: bibr8-10769986231159137
  doi: 10.1177/0146621604272623
– ident: bibr10-10769986231159137
  doi: 10.3389/fpsyg.2022.851378
– ident: bibr14-10769986231159137
  doi: 10.1177/0146621616638643
– ident: bibr18-10769986231159137
  doi: 10.1080/14794802.2017.1325776
– ident: bibr119-10769986231159137
  doi: 10.1177/0146621613502704
– ident: bibr115-10769986231159137
  doi: 10.1007/s12564-011-9196-3
– ident: bibr13-10769986231159137
  doi: 10.1016/j.stueduc.2009.10.003
– ident: bibr111-10769986231159137
  doi: 10.1177/01466210122032064
– ident: bibr20-10769986231159137
– volume-title: A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality
  year: 2002
  ident: bibr7-10769986231159137
– ident: bibr12-10769986231159137
  doi: 10.1177/0265532214558457
– ident: bibr3-10769986231159137
  doi: 10.1111/j.1745-3984.2011.00158.x
– ident: bibr6-10769986231159137
  doi: 10.1080/15305058.2010.509554
– ident: bibr2-10769986231159137
  doi: 10.1111/emip.12020
– ident: bibr9-10769986231159137
  doi: 10.1007/s11336-008-9089-5
– ident: bibr21-10769986231159137
  doi: 10.1080/15366367.2018.1435104
– ident: bibr118-10769986231159137
  doi: 10.3389/fpsyg.2021.614470
– ident: bibr17-10769986231159137
  doi: 10.1080/10627197.2013.761522
SSID ssj0013243
Score 2.3437936
Snippet This article provides a process to carefully evaluate the suitability of a content domain for which diagnostic classification models (DCMs) could be applicable...
SourceID proquest
eric
crossref
sage
SourceType Aggregation Database
Index Database
Publisher
StartPage 750
SubjectTerms Classification
Middle Schools
Physics
Science Tests
Statistical Analysis
Test Items
Title Optimizing Diagnostic Classification Models Application Considering Real-Life Constraints
URI https://journals.sagepub.com/doi/full/10.3102/10769986231159137
http://eric.ed.gov/ERICWebPortal/detail?accno=EJ1401155
https://www.proquest.com/docview/2890700491
Volume 48
hasFullText 1
inHoldings 1
isFullTextHit
isPrint
link http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1ba9swGBVZ-tKX0XUry9oVPQwGG-ps2Zblx7B1hNLuwlpon4x1g0KXljZ56a_f91myrfQCa19MUILk6BxJR9J3IeSDgCVLV2nFTKYsy7XWTNm8YRIXQ6M58Bo3ikc_xOwkPzgtTkejq8hqablQe_r2Qb-S56AKZYAresk-Adm-UiiAz4AvPAFheP4Xxj9hvP89v8Xd_jdvMofhV9s8l2gB5LHFbGcXN15uhqIuS6c3vWsu2OG5s21pmzHCB3d6QLLazhokBBiIfPzRMcnHfB6umdpJZNmzb2Y7RzNvzv15uhefOfAsst_w02RSCgYbtRDE2pdVGcY09SGhu7k1lxGH4omy9OFmw5pb-vQ9d6dzkJ68PVkoBTbGMTJQlfogMauhs-8sab2hIWxxsJL6XhUvyBqHVvmYrE3Pfv0-im6eglNG-If-Jhwr-XKvkhUts2ouj_uUyDSwVSvHG-RlwIxOPWdekZGdb2KG7oDfJln_0wP2mpwNRKIDkegqkagnEo2IRCMi0Z5INCLSG3Lyff_464yFnBsMxqVYMCcTWxnuMiMroVShC5mBws4VjOhCSFBzwhlVGNnoKnFNKUSjeIayW4DsARm0Rcbzy7l9SyhI_SYRiUmlVrkojEqbTBfOWJc03Ek3IZ-63quvfGiV-lG8JmQL-7f_4f4BngyAGJ6Qna7H6zA0b2q8Pce8DVU6IR8RheGrR1t495TX2Sbrw7jYIePF9dK-B3W6ULuBULvtScw_fIeI0w
linkProvider SAGE Publications
linkToHtml http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1LS8QwEB50PbgX34vrswdBECJ9ZtPj4oNVd33hwoqH0iQNLOoqbr34651pU9-CeCo0SZtm0nzfMF8yAFscIUvFXsx0IDMWKqWYzMKUCQJDrXyc1-Qo9k55px8eD6KBVVXSXhg7guNdklVhj4rF2v7dyER8vLY4ugiI2shlYi9oTcKUoN0INZhqX59f9D7EEKy8vsUZtShjmj8_5BMqfRY-E-P8IPIqcOdwFm6qHpdyk9vd5xw7-_LlMMf_fdIczFg66rTL-TMPE9logTI5W9XHAtSJjZaHOS_C9RkuMPfDF4Q7Z7_U6GGBUyTWJMlR0cah9Gp3Y6f9Hhp3qrSg1PASqSnrDk1W3C1SVOTjJegfHlztdZjNzcDQfjxnRrhZrH0TaBFzKSMViQCZWCjR8hEXiPrcaBlpkarYNWmL81T6AdEzjvCIcNmA2uhhlC2Dg5QwdbmrPaFkyCMtvTRQkdGZcVPfCNOEnco2yWN5BEeCrgsNXfJt6JrQIOu9VTw4Jg8SSVMT1ip7JpVFEoqy0vn-sdeEbTLPe9Gvb1j5c81NmO5c9bpJ9-j0ZBXqlKi-FMKsQS1_es7Wkc7kcsPO21cALeX3
linkToPdf http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1bS8MwFD7oBrIX78N57YMgCNFes_ZxqGPOOac4cE-lSRoY6hyue_HXe04vznkB8anQJG2ak-b7TvP1HIBDjpAlAytgyhExc6WUTMRuxHwCQyVtnNfkKF53eavvth-8h_yDG_0Lk4_g5IRkVdijdLGmt3us9GnqYpo2Husc3QREbuQzgeXUF6GMQGXbJSg3Br3b60_7CLnEvs4Ztcj2NX--yBwyzYufiXV-Enql2NNcgbDodSY5eTyZJtjhty8BHf__WKuwnNNSo5HNozVYiEfrlNE5V3-sQ4VYaRbUeQMGN7jQPA_fEPaM80yrhwVGmmCTpEdpG4PSrD1NjMZsi9wo0oNSwzukqKwz1HF6Nk1VkUw2od-8uD9rsTxHA0M78oRp34wDZWtH-QEXwpOe7yAjcwXOAI_7iP5cK-EpP5KBqaM655GwHaJpHGESYbMKpdHLKN4CA6lhZHJTWb4ULveUsCJHelrF2oxs7esaHBf2CcdZKI4QXRgauvDb0NWgShb8qHjRJk8SyVMNdgubhoVVQtptpTj_gVWDIzLRrOjXO2z_ueYBLPXOm2Hnsnu1AxXKV5_pYXahlLxO4z1kNYnYz6fuO7DM6Gw
openUrl ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Optimizing+Diagnostic+Classification+Models+Application+Considering+Real-Life+Constraints&rft.jtitle=Journal+of+educational+and+behavioral+statistics&rft.au=Su%2C+Kun&rft.au=Henson%2C+Robert+A.&rft.date=2023-12-01&rft.issn=1076-9986&rft.eissn=1935-1054&rft.volume=48&rft.issue=6&rft.spage=750&rft.epage=772&rft_id=info:doi/10.3102%2F10769986231159137&rft.externalDBID=n%2Fa&rft.externalDocID=10_3102_10769986231159137
thumbnail_l http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1076-9986&client=summon
thumbnail_m http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1076-9986&client=summon
thumbnail_s http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1076-9986&client=summon