Though Forced, Still Valid: Psychometric Equivalence of Forced-Choice and Single-Statement Measures
Forced-choice (FC) measures are gaining popularity as an alternative assessment format to single-statement (SS) measures. However, a fundamental question remains to be answered: Do FC and SS instruments measure the same underlying constructs? In addition, FC measures are theorized to be more cogniti...
Saved in:
| Published in | Organizational research methods Vol. 23; no. 3; pp. 569 - 590 |
|---|---|
| Main Authors | , , , , , , |
| Format | Journal Article |
| Language | English |
| Published |
Los Angeles, CA
SAGE Publications
01.07.2020
SAGE PUBLICATIONS, INC |
| Subjects | |
| Online Access | Get full text |
Cover
Loading…
| Abstract | Forced-choice (FC) measures are gaining popularity as an alternative assessment format to single-statement (SS) measures. However, a fundamental question remains to be answered: Do FC and SS instruments measure the same underlying constructs? In addition, FC measures are theorized to be more cognitively challenging, so how would this feature influence respondents’ reactions to FC measures compared to SS? We used both between- and within-subjects designs to examine the equivalence of the FC format and the SS format. As the results illustrate, FC measures scored by the multi-unidimensional pairwise preference (MUPP) model and SS measures scored with the generalized graded unfolding model (GGUM) showed strong equivalence. Specifically, both formats demonstrated similar marginal reliabilities and test-retest reliabilities, high convergent validities, good discriminant validities, and similar criterion-related validities with theoretically relevant criteria. In addition, the formats had little differential impact on respondents’ general emotional and cognitive reactions except that the FC format was perceived to be slightly more difficult and more time-saving. |
|---|---|
| AbstractList | Forced-choice (FC) measures are gaining popularity as an alternative assessment format to single-statement (SS) measures. However, a fundamental question remains to be answered: Do FC and SS instruments measure the same underlying constructs? In addition, FC measures are theorized to be more cognitively challenging, so how would this feature influence respondents’ reactions to FC measures compared to SS? We used both between- and within-subjects designs to examine the equivalence of the FC format and the SS format. As the results illustrate, FC measures scored by the multi-unidimensional pairwise preference (MUPP) model and SS measures scored with the generalized graded unfolding model (GGUM) showed strong equivalence. Specifically, both formats demonstrated similar marginal reliabilities and test-retest reliabilities, high convergent validities, good discriminant validities, and similar criterion-related validities with theoretically relevant criteria. In addition, the formats had little differential impact on respondents’ general emotional and cognitive reactions except that the FC format was perceived to be slightly more difficult and more time-saving. |
| Author | Drasgow, Fritz Chernyshenko, Oleksandr S. Zhang, Bo Nye, Christopher D. Sun, Tianjun Stark, Stephen White, Leonard A. |
| Author_xml | – sequence: 1 givenname: Bo orcidid: 0000-0002-6730-7336 surname: Zhang fullname: Zhang, Bo email: bozhang3@illinois.edu – sequence: 2 givenname: Tianjun surname: Sun fullname: Sun, Tianjun – sequence: 3 givenname: Fritz surname: Drasgow fullname: Drasgow, Fritz – sequence: 4 givenname: Oleksandr S. surname: Chernyshenko fullname: Chernyshenko, Oleksandr S. – sequence: 5 givenname: Christopher D. surname: Nye fullname: Nye, Christopher D. – sequence: 6 givenname: Stephen surname: Stark fullname: Stark, Stephen – sequence: 7 givenname: Leonard A. surname: White fullname: White, Leonard A. |
| BookMark | eNp1kM1Lw0AQxRepYFu9e1zw6up-ZhNvUloVKgqtXsNmM2lS0my7mxT635vSgiB4mmHe772BN0KDxjWA0C2jD4xp_choIiWPGUtiEck4ukBDphQnWnI16PdeJkf9Co1CWFPKBFfJENll6bpViWfOW8jv8aKt6hp_m7rKn_BnONjSbaD1lcXTXVftTQ2NBeyKs4FMSlf1B9PkeFE1qxrIojUtbKBp8TuY0HkI1-iyMHWAm_Mco6_ZdDl5JfOPl7fJ85xYSeOWGAvW5FwplSXciEKITOssl7EQUjPguZaQ6IJa0DyiVEiW0STmnDItVR5lYozuTrlb73YdhDZdu843_cuUS6qV0DJiPUVPlPUuBA9FuvXVxvhDymh6rDL9W2VvISdLMCv4Df2X_wEgkHPl |
| CitedBy_id | crossref_primary_10_1080_00273171_2023_2235682 crossref_primary_10_1111_ijsa_12345 crossref_primary_10_3758_s13428_022_01927_z crossref_primary_10_1177_10731911211008245 crossref_primary_10_5093_jwop2021a7 crossref_primary_10_1007_s10869_023_09911_w crossref_primary_10_1027_1015_5759_a000609 crossref_primary_10_1177_10944281231181642 crossref_primary_10_3390_psych6010006 crossref_primary_10_1080_08995605_2023_2244818 crossref_primary_10_1177_01466216211051726 crossref_primary_10_1177_10944281231210481 crossref_primary_10_2298_PSI220307031B crossref_primary_10_1177_10731911241255841 crossref_primary_10_1177_10944281221115374 crossref_primary_10_1177_00131644231171193 crossref_primary_10_1177_10944281211002904 crossref_primary_10_1177_10944281241229784 crossref_primary_10_1177_00131644231178721 crossref_primary_10_1002_hrdq_21521 crossref_primary_10_1016_j_heliyon_2024_e26884 crossref_primary_10_3389_fpsyg_2019_02309 crossref_primary_10_1111_peps_12353 crossref_primary_10_1080_00273171_2021_1938960 crossref_primary_10_1177_00131644231222420 crossref_primary_10_1007_s10869_023_09876_w crossref_primary_10_3724_SP_J_1042_2022_01410 crossref_primary_10_3758_s13428_023_02315_x |
| Cites_doi | 10.1037/a0028301 10.1037/pas0000132 10.1111/j.1754-9434.2010.01273.x 10.1037/0021-9010.88.5.879 10.1007/s11135-011-9640-9 10.1177/1073191114568113 10.1023/A:1007136110218 10.1093/med:psych/9780199356942.003.0024 10.1037/a0018721 10.1177/1094428116668036 10.1177/1073191116641181 10.1111/1467-9884.00122 10.1177/1094428112444611 10.1037/0021-9010.87.3.530 10.1037/1040-3590.19.1.88 10.1177/0013164410375112 10.1037/0882-7974.16.3.414 10.1177/1073191115583714 10.1007/s10869-013-9318-5 10.1037/a0015899 10.1111/j.1744-6570.1993.tb00867.x 10.1177/0022022106297301 10.1111/j.1745-3984.1984.tb01039.x 10.1177/0734282914550387 10.1177/014662169602000305 10.1080/10705511.2017.1392247 10.1177/1094428114555993 10.1177/1094428105275374 10.1016/j.paid.2019.01.022 10.1037/0021-9010.78.6.966 10.1080/15305058.2016.1145123 10.1080/08959280902743303 10.1177/001316440206200112 10.1111/j.1365-2923.2012.04355.x 10.1177/0013164417752782 10.1037/mil0000044 10.1037/0021-9010.91.1.25 10.1037/h0029780 10.1016/j.paid.2011.07.033 10.1037/0033-2909.103.3.299 10.1111/j.1744-6570.2003.tb00152.x 10.1108/eb028952 10.1080/00273171.2016.1150152 10.1037/1082-989X.1.2.170 10.1016/j.paid.2017.11.031 10.1016/j.jrp.2015.12.002 10.1016/j.paid.2010.06.019 10.1111/j.0965-075X.2004.282_1.x 10.1037/pspp0000096 10.1037/e559902013-001 10.1207/s15327043hup1703_4 10.1037/0022-3514.59.6.1216 10.1111/j.1468-2389.2007.00386.x 10.1037/0021-9010.73.4.749 10.1080/15305058.2017.1345913 10.1007/s11336-014-9434-9 10.1111/j.1744-6570.2004.00003.x 10.1016/0191-8869(95)00119-Q 10.1177/00131649921969802 10.1037/a0030641 10.1177/014920639802400304 10.1037/met0000101 10.1037/0033-2909.87.1.72 10.1177/00131649921969811 10.2307/1412159 10.1037/0033-2909.134.1.138 10.1177/0146621604273988 10.1207/s15327752jpa4901_13 10.1006/jrpe.2001.2335 10.1016/j.jrp.2008.05.006 |
| ContentType | Journal Article |
| Copyright | The Author(s) 2019 |
| Copyright_xml | – notice: The Author(s) 2019 |
| DBID | AAYXX CITATION 7TA 7TB 8FD FR3 JG9 |
| DOI | 10.1177/1094428119836486 |
| DatabaseName | CrossRef Materials Business File Mechanical & Transportation Engineering Abstracts Technology Research Database Engineering Research Database Materials Research Database |
| DatabaseTitle | CrossRef Materials Research Database Engineering Research Database Technology Research Database Mechanical & Transportation Engineering Abstracts Materials Business File |
| DatabaseTitleList | Materials Research Database CrossRef |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Business |
| EISSN | 1552-7425 |
| EndPage | 590 |
| ExternalDocumentID | 10_1177_1094428119836486 10.1177_1094428119836486 |
| GroupedDBID | -MK -TM .2G .2L 01A 09Z 0R~ 123 1~K 29N 31S 31V 31W 31X 3V. 4.4 56W 5VS 7WY 8FL 8R4 8R5 AABOD AACKU AADIR AADUE AAGGD AAJPV AAKTJ AAMFR AAMGE AANSI AAPEO AAQDB AARIX AATAA AAUIH AAWLO AAZCK ABAWP ABCCA ABDLQ ABEIX ABFXH ABHQH ABIVO ABJNI ABKRH ABPNF ABQDK ABQKF ABQPY ABQXT ABRHV ABTDE ABUWG ABYTW ACAEP ACDXX ACFUR ACFZE ACGFS ACHQT ACIWK ACLZU ACOFE ACOXC ACROE ACSIQ ACTQU ACUFS ACUIR ADEIA ADPEE ADRRZ ADTOS ADUKL AEOBU AESMA AESZF AEUHG AEUIJ AEVPJ AEWDL AEWHI AEXNY AFEET AFKBI AFKRA AFKRG AFMOU AFQAA AFUIA AGDVU AGKLV AGNHF AGNWV AGUGZ AHHFK AHWHD AIOMO AJUZI AKVCP ALJHS ALMA_UNASSIGNED_HOLDINGS ANDLU ARTOV ASPBG AUTPY AUVAJ AVWKF AYPQM AZFZN B8O B8S B8T B8Z BDZRT BENPR BEZIV BMVBW BPACV BPHCQ BYIEH CAG CBRKF CCGJY CCPQU CEADM COF CS3 DD0 DD~ DG~ DOPDO DU5 DV7 DV8 DWQXO EBS EJD FEDTE FHBDP FRNLG GROUPED_ABI_INFORM_COMPLETE GROUPED_ABI_INFORM_RESEARCH GROUPED_SAGE_PREMIER_JOURNAL_COLLECTION HF~ HVGLF HZ~ J8X JCYGO K60 K6~ M0C M4V MS~ N9A O9- P.B P2P PQBIZ PQBZA PQQKQ PROAC Q1R Q2X Q7O Q7P Q7X RIG ROL S01 SBI SCNPE SFB SFC SFK SFM SFT SFX SGP SGU SGV SHB SHF SHM SPJ SPP SQCSI SSDHQ TH9 TN5 WH7 ZPLXX ZPPRI ~32 AAYXX ACJER ACRPL ADYCS AEDXQ AGWNL CITATION H13 7TA 7TB 8FD FR3 JG9 |
| ID | FETCH-LOGICAL-c408t-acecad2555b92a3f33b77bd4833471e2d74e97f0ce72600341b0982201745d6b3 |
| ISSN | 1094-4281 |
| IngestDate | Thu Nov 21 05:39:25 EST 2024 Fri Dec 06 07:34:01 EST 2024 Tue Jul 16 20:48:54 EDT 2024 |
| IsDoiOpenAccess | false |
| IsOpenAccess | true |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 3 |
| Keywords | forced-choice GGUM equivalence MUPP single-statement |
| Language | English |
| LinkModel | OpenURL |
| MergedId | FETCHMERGED-LOGICAL-c408t-acecad2555b92a3f33b77bd4833471e2d74e97f0ce72600341b0982201745d6b3 |
| ORCID | 0000-0002-6730-7336 |
| OpenAccessLink | https://www.ideals.illinois.edu/items/109531/bitstreams/358203/data.pdf |
| PQID | 2407537461 |
| PQPubID | 32387 |
| PageCount | 22 |
| ParticipantIDs | proquest_journals_2407537461 crossref_primary_10_1177_1094428119836486 sage_journals_10_1177_1094428119836486 |
| PublicationCentury | 2000 |
| PublicationDate | 2020-07-01 |
| PublicationDateYYYYMMDD | 2020-07-01 |
| PublicationDate_xml | – month: 07 year: 2020 text: 2020-07-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | Los Angeles, CA |
| PublicationPlace_xml | – name: Los Angeles, CA – name: Thousand Oaks |
| PublicationTitle | Organizational research methods |
| PublicationYear | 2020 |
| Publisher | SAGE Publications SAGE PUBLICATIONS, INC |
| Publisher_xml | – name: SAGE Publications – name: SAGE PUBLICATIONS, INC |
| References | Fraser, Ma, Teteris, Baxter, Wright, McLaughlin 2012 11; 46 Krumpal 2013; 47 Dueber, Love, Toland, Turner 2019; 79 Dunlap, Cortina, Vaslow, Burke 1996; 1 Steel, Schmidt, Shultz 2008; 134 Usami, Sakamoto, Naito, Abe 2016; 16 Cao, Drasgow, Cho 2015; 18 Pinquart 2001; 16 Brown, Inceoglu, Lin 2017; 20 Hicks 1970; 74 Saucier 2002; 36 Nye, Drasgow, Chernyshenko, Stark, Kubisiak, White, Jose 2012 Stark, Chernyshenko, Drasgow, Nye, White, Heffner, Farmer 2014; 26 Cao, Song, Tay 2018; 18 Judge, Van Vianen, De Pater 2004; 17 Joanes, Gill 1998; 47 Thompson 2007; 38 Brown 2016; 51 Lee, Joo, Lee 2019; 142 Wetzel, Roberts, Fraley, Brown 2016; 61 Guenole, Brown, Cooper 2018; 25 Sass, Frick, Reips, Wetzel 2018 Tay, Drasgow, Rounds, Williams 2009; 94 Bartram, Brown 2004; 12 Pavlov, Maydeu-Olivares, Fairchild 2018 Weijters, Geuens, Schillewaert 2010; 15 Landy, Farr 1980; 87 Brown, Maydeu-Olivares 2011; 71 Judge, Erez, Bono, Thoresen 2003; 56 Stark, Chernyshenko, Drasgow, White 2012; 15 Viswesvaran, Ones 1999; 59 Roberts, Laughlin, Wedell 1999; 59 Hausknecht, Day, Thomas 2004; 57 Green, Bock, Humphreys, Linn, Reckase 1984; 21 Wetzel, Lüdtke, Zettler, Böhnke 2016; 23 Stephan, Demulier, Terracciano 2012; 27 Bowen, Martin, Hunt 2002; 10 Lee, Joo, Stark, Chernyshenko 2018 Ackerman, Donnellan, Roberts, Fraley 2016; 23 Drasgow, Chernyshenko, Stark 2010; 3 Bartram 2007; 15 Stanton, Sinar, Balzer, Julian, Thoresen, Aziz, Smith 2002; 62 Podsakoff, MacKenzie, Lee, Podsakoff 2003; 88 Chernyshenko, Stark, Drasgow, Roberts 2007; 19 Roberts, Laughlin 1996; 20 McCloy, Heggestad, Reeve 2005; 8 Thurstone 1927; 79 Brown, Maydeu-Olivares 2013; 18 Chernyshenko, Stark, Prewett, Gray, Stilson, Tuttle 2009; 22 Smither, Reilly, Millsap, Pearlman, Stoffey 1993; 46 Stark, Chernyshenko, Drasgow, Williams 2006; 91 Meglino, Ravlin 1998; 24 Anguiano-Carrasco, MacCann, Geiger, Seybert, Roberts 2015; 33 Carter, Dalal, Guan, LoPilato, Withrow 2017; 22 Donovan, Dwight, Schneider 2014; 29 Schmit, Ryan 1993; 78 Tourangeau, Rasinski 1988; 103 Stark, Chernyshenko, Drasgow 2005; 29 Duijsens, Diekstra 1995; 19 Diener, Emmons, Larsen, Griffin 1985; 49 Sharpe, Martin, Roth 2011; 51 Spearman 1904; 15 Tenopyr 1988; 73 Carter, Dalal 2010; 49 Likert 1932; 140 Lee, Lee, Stark 2018; 123 Brown, Maydeu-Olivares 2017; 25 Goldberg 1990; 59 Soto, John 2017; 113 Löckenhoff, Sutin, Ferrucci, Costa 2008; 42 Brown 2016; 81 Milligan 2003; 64 Bürkner, Schulte, Holling Bostic, Rubio, Hood 2000; 52 Cho, Drasgow, Cao 2015; 27 Judge, Heller, Mount 2002; 87 bibr54-1094428119836486 bibr11-1094428119836486 Thurstone L. L. (bibr76-1094428119836486) 1927; 79 bibr62-1094428119836486 bibr8-1094428119836486 bibr20-1094428119836486 bibr37-1094428119836486 bibr71-1094428119836486 bibr45-1094428119836486 John O. P. (bibr34-1094428119836486) 1999 bibr28-1094428119836486 bibr61-1094428119836486 bibr10-1094428119836486 bibr79-1094428119836486 bibr36-1094428119836486 bibr70-1094428119836486 bibr44-1094428119836486 bibr27-1094428119836486 bibr9-1094428119836486 bibr53-1094428119836486 bibr73-1094428119836486 bibr86-1094428119836486 bibr65-1094428119836486 bibr60-1094428119836486 bibr78-1094428119836486 Likert R. (bibr43-1094428119836486) 1932; 140 bibr19-1094428119836486 bibr26-1094428119836486 Bürkner P. C. (bibr13-1094428119836486) bibr39-1094428119836486 Rundquist E. A. (bibr55-1094428119836486) 1946 bibr6-1094428119836486 bibr42-1094428119836486 bibr47-1094428119836486 Sass R. (bibr57-1094428119836486) 2018 bibr50-1094428119836486 bibr21-1094428119836486 bibr63-1094428119836486 bibr3-1094428119836486 Nye C. D. (bibr87-1094428119836486) 2012 bibr68-1094428119836486 bibr81-1094428119836486 bibr29-1094428119836486 bibr16-1094428119836486 bibr59-1094428119836486 bibr67-1094428119836486 bibr24-1094428119836486 bibr75-1094428119836486 bibr33-1094428119836486 bibr32-1094428119836486 bibr2-1094428119836486 Pavlov G. (bibr49-1094428119836486) 2018 bibr15-1094428119836486 bibr58-1094428119836486 bibr74-1094428119836486 bibr23-1094428119836486 Milligan M. (bibr48-1094428119836486) 2003; 64 bibr66-1094428119836486 bibr1-1094428119836486 bibr31-1094428119836486 bibr18-1094428119836486 Lee P. (bibr41-1094428119836486) 2018 bibr40-1094428119836486 bibr83-1094428119836486 bibr35-1094428119836486 bibr5-1094428119836486 bibr22-1094428119836486 bibr30-1094428119836486 bibr69-1094428119836486 bibr4-1094428119836486 Revelle W. (bibr52-1094428119836486) 2016 bibr82-1094428119836486 bibr80-1094428119836486 bibr85-1094428119836486 Cao M. (bibr14-1094428119836486) bibr17-1094428119836486 bibr72-1094428119836486 bibr77-1094428119836486 bibr38-1094428119836486 bibr64-1094428119836486 bibr25-1094428119836486 bibr51-1094428119836486 bibr12-1094428119836486 bibr7-1094428119836486 |
| References_xml | – volume: 46 start-page: 1055 year: 2012 11 end-page: 1062 article-title: Emotion, cognitive load and learning outcomes during simulation training publication-title: Medical Education contributor: fullname: McLaughlin – volume: 74 start-page: 167 issue: 3 year: 1970 end-page: 184 article-title: Some properties of ipsative, normative, and forced-choice normative measures publication-title: Psychological Bulletin contributor: fullname: Hicks – year: 2012 publication-title: Assessing the Tailored Adaptive Personality Assessment System (TAPAS) as an MOS qualification instrument contributor: fullname: Jose – year: 2018 article-title: GGUM-RANK statement and person parameter estimation with multidimensional forced choice triplets publication-title: Applied Psychological Measurement contributor: fullname: Chernyshenko – volume: 16 start-page: 414 issue: 3 year: 2001 end-page: 426 article-title: Correlates of subjective health in older adults: A meta-analysis publication-title: Psychology and Aging contributor: fullname: Pinquart – volume: 79 start-page: 108 year: 2019 end-page: 128 article-title: Comparison of single-response format and forced-choice format instruments using Thurstonian item response theory publication-title: Educational and Psychological Measurement contributor: fullname: Turner – volume: 3 start-page: 465 issue: 4 year: 2010 end-page: 476 article-title: 75 years after Likert: Thurstone was right! publication-title: Industrial and Organizational Psychology contributor: fullname: Stark – volume: 87 start-page: 72 issue: 1 year: 1980 end-page: 107 article-title: Performance rating publication-title: Psychological Bulletin contributor: fullname: Farr – volume: 15 start-page: 463 issue: 3 year: 2012 end-page: 487 article-title: Adaptive testing with multidimensional pairwise preference items: Improving the efficiency of personality and other noncognitive assessments publication-title: Organizational Research Methods contributor: fullname: White – volume: 91 start-page: 25 issue: 1 year: 2006 end-page: 39 article-title: Examining assumptions about item responding in personality assessment: Should ideal point methods be considered for scale development and scoring? publication-title: Journal of Applied Psychology contributor: fullname: Williams – volume: 79 start-page: 281 year: 1927 end-page: 299 article-title: A law of comparative judgment publication-title: Psychological Review contributor: fullname: Thurstone – volume: 47 start-page: 2025 issue: 4 year: 2013 end-page: 2047 article-title: Determinants of social desirability bias in sensitive surveys: A literature review publication-title: Quality & Quantity contributor: fullname: Krumpal – volume: 52 start-page: 313 issue: 3 year: 2000 end-page: 324 article-title: A validation of the subjective vitality scale using structural equation modeling publication-title: Social Indicators Research contributor: fullname: Hood – volume: 20 start-page: 231 issue: 3 year: 1996 end-page: 255 article-title: A unidimensional item response model for unfolding responses from a graded disagree-agree response scale publication-title: Applied Psychological Measurement contributor: fullname: Laughlin – volume: 47 start-page: 183 issue: 1 year: 1998 end-page: 189 article-title: Comparing measures of sample skewness and kurtosis publication-title: Journal of the Royal Statistical Society: Series D (The Statistician) contributor: fullname: Gill – volume: 18 start-page: 178 issue: 2 year: 2018 end-page: 205 article-title: Detecting curvilinear relationships: A comparison of scoring approaches based on different item response models publication-title: International Journal of Testing contributor: fullname: Tay – volume: 88 start-page: 879 issue: 5 year: 2003 end-page: 903 article-title: Common method biases in behavioral research: A critical review of the literature and recommended remedies publication-title: Journal of Applied Psychology contributor: fullname: Podsakoff – year: 2018 article-title: Taking the test taker’s perspective: Response process and test motivation in multidimensional forced-choice versus rating scale instruments publication-title: Assessment contributor: fullname: Wetzel – volume: 59 start-page: 1216 issue: 6 year: 1990 end-page: 1229 article-title: An alternative “description of personality”: The big-five factor structure publication-title: Journal of Personality and Social Psychology contributor: fullname: Goldberg – volume: 142 start-page: 13 year: 2019 end-page: 20 article-title: Examining stability of personality profile solutions between Likert-type and multidimensional forced choice measure publication-title: Personality and Individual Differences contributor: fullname: Lee – volume: 27 start-page: 875 issue: 4 year: 2012 end-page: 880 article-title: Personality, self-rated health, and subjective age in a life-span sample: The moderating role of chronological age publication-title: Psychology and Aging contributor: fullname: Terracciano – volume: 59 start-page: 197 issue: 2 year: 1999 end-page: 210 article-title: Meta-analyses of fakability estimates: Implications for personality measurement publication-title: Educational and Psychological Measurement contributor: fullname: Ones – volume: 19 start-page: 88 issue: 1 year: 2007 end-page: 106 article-title: Constructing personality scales under the assumptions of an ideal point response process: Toward increasing the flexibility of personality measures publication-title: Psychological Assessment contributor: fullname: Roberts – volume: 16 start-page: 288 issue: 4 year: 2016 end-page: 309 article-title: Developing pairwise preference-based personality test and experimental investigation of its resistance to faking effect by item response model publication-title: International Journal of Testing contributor: fullname: Abe – volume: 103 start-page: 299 issue: 3 year: 1988 end-page: 314 article-title: Cognitive processes underlying context effects in attitude measurement publication-title: Psychological Bulletin contributor: fullname: Rasinski – volume: 113 start-page: 117 issue: 1 year: 2017 end-page: 143 article-title: The next Big Five Inventory (BFI-2): Developing and assessing a hierarchical model with 15 facets to enhance bandwidth, fidelity, and predictive power publication-title: Journal of Personality and Social Psychology contributor: fullname: John – article-title: On the statistical and practical limitations of Thurstonian IRT models publication-title: Educational and Psychological Measurement contributor: fullname: Holling – volume: 81 start-page: 135 issue: 1 year: 2016 end-page: 160 article-title: Item response models for forced-choice questionnaires: A common framework publication-title: Psychometrika contributor: fullname: Brown – volume: 18 start-page: 36 issue: 1 year: 2013 end-page: 52 article-title: How IRT can solve problems of ipsative data in forced-choice questionnaires publication-title: Psychological Methods contributor: fullname: Maydeu-Olivares – volume: 51 start-page: 946 issue: 8 year: 2011 end-page: 951 article-title: Optimism and the big five factors of personality: Beyond neuroticism and extraversion publication-title: Personality and Individual Differences contributor: fullname: Roth – volume: 78 start-page: 966 issue: 6 year: 1993 end-page: 974 article-title: The big five in personnel selection: Factor structure in applicant and nonapplicant populations publication-title: Journal of Applied Psychology contributor: fullname: Ryan – volume: 8 start-page: 222 issue: 2 year: 2005 end-page: 248 article-title: A silk purse from the sow’s ear: Retrieving normative information from multidimensional forced-choice items publication-title: Organizational Research Methods contributor: fullname: Reeve – volume: 46 start-page: 49 issue: 1 year: 1993 end-page: 76 article-title: Applicant reactions to selection procedures publication-title: Personnel Psychology contributor: fullname: Stoffey – volume: 22 start-page: 191 issue: 1 year: 2017 end-page: 203 article-title: Item response theory scoring and the detection of curvilinear relationships publication-title: Psychological Methods contributor: fullname: Withrow – volume: 61 start-page: 87 year: 2016 end-page: 98 article-title: Equivalence of Narcissistic Personality Inventory constructs and correlates across scoring approaches and response formats publication-title: Journal of Research in Personality contributor: fullname: Brown – volume: 27 start-page: 1241 issue: 4 year: 2015 end-page: 1252 article-title: An investigation of emotional intelligence measures using item response theory publication-title: Psychological Assessment contributor: fullname: Cao – volume: 134 start-page: 138 issue: 1 year: 2008 end-page: 161 article-title: Refining the relationship between personality and subjective well-being publication-title: Psychological Bulletin contributor: fullname: Shultz – volume: 87 start-page: 530 issue: 3 year: 2002 end-page: 541 article-title: Five-factor model of personality and job satisfaction: A meta-analysis publication-title: Journal of Applied Psychology contributor: fullname: Mount – volume: 23 start-page: 279 issue: 3 year: 2016 end-page: 291 article-title: The stability of extreme response style and acquiescence over 8 years publication-title: Assessment contributor: fullname: Böhnke – volume: 33 start-page: 83 issue: 1 year: 2015 end-page: 97 article-title: Development of a forced-choice measure of typical-performance emotional intelligence publication-title: Journal of Psychoeducational Assessment contributor: fullname: Roberts – volume: 15 start-page: 96 issue: 1 year: 2010 end-page: 110 article-title: The stability of individual response styles publication-title: Psychological Methods contributor: fullname: Schillewaert – volume: 49 start-page: 743 issue: 7 year: 2010 end-page: 748 article-title: An ideal point account of the JDI Work satisfaction scale publication-title: Personality and Individual Differences contributor: fullname: Dalal – volume: 12 start-page: 278 issue: 3 year: 2004 end-page: 284 article-title: Online testing: Mode of administration and the stability of OPQ 32i scores publication-title: International Journal of Selection and Assessment contributor: fullname: Brown – volume: 15 start-page: 72 year: 1904 end-page: 101 article-title: The proof and measurement of association between two things publication-title: American Journal of Psychology contributor: fullname: Spearman – volume: 1 start-page: 170 issue: 2 year: 1996 end-page: 177 article-title: Meta-analysis of experiments with matched groups or repeated measures designs publication-title: Psychological Methods contributor: fullname: Burke – volume: 15 start-page: 263 issue: 3 year: 2007 end-page: 272 article-title: Increasing validity with forced-choice criterion measurement formats publication-title: International Journal of Selection and Assessment contributor: fullname: Bartram – volume: 26 start-page: 153 issue: 3 year: 2014 end-page: 164 article-title: From ABLE to TAPAS: A new generation of personality tests to support military selection and classification decisions publication-title: Military Psychology contributor: fullname: Farmer – volume: 94 start-page: 1287 issue: 5 year: 2009 end-page: 1304 article-title: Fitting measurement models to vocational interest data: Are dominance models ideal? publication-title: Journal of Applied Psychology contributor: fullname: Williams – volume: 20 start-page: 121 issue: 1 year: 2017 end-page: 148 article-title: Preventing rater biases in 360-degree feedback by forcing choice publication-title: Organizational Research Methods contributor: fullname: Lin – year: 2018 article-title: Effects of applicant faking on forced-choice and Likert scores publication-title: Organizational Research Methods contributor: fullname: Fairchild – volume: 25 start-page: 516 issue: 4 year: 2017 end-page: 529 article-title: Ordinal factor analysis of graded-preference questionnaire data publication-title: Structural Equation Modeling: A Multidisciplinary Journal contributor: fullname: Maydeu-Olivares – volume: 140 start-page: 1 year: 1932 end-page: 55 article-title: A technique for the measurement of attitudes publication-title: Archives of Psychology contributor: fullname: Likert – volume: 29 start-page: 479 issue: 3 year: 2014 end-page: 493 article-title: The impact of applicant faking on selection measures, hiring decisions, and employee performance publication-title: Journal of Business and Psychology contributor: fullname: Schneider – volume: 64 start-page: 5830 issue: 11-B year: 2003 article-title: Optimism and the five-factor model of personality, coping, and health behavior publication-title: Dissertation Abstracts International contributor: fullname: Milligan – volume: 23 start-page: 203 issue: 2 year: 2016 end-page: 220 article-title: The effect of response format on the psychometric properties of the Narcissistic Personality Inventory: Consequences for item meaning and factor structure publication-title: Assessment contributor: fullname: Fraley – volume: 21 start-page: 347 issue: 4 year: 1984 end-page: 360 article-title: Technical guidelines for assessing computerized adaptive tests publication-title: Journal of Educational Measurement contributor: fullname: Reckase – volume: 71 start-page: 460 issue: 3 year: 2011 end-page: 502 article-title: Item response modeling of forced-choice questionnaires publication-title: Educational and Psychological Measurement contributor: fullname: Maydeu-Olivares – volume: 59 start-page: 211 issue: 2 year: 1999 end-page: 233 article-title: Validity issues in the Likert and Thurstone approaches to attitude measurement publication-title: Educational and Psychological Measurement contributor: fullname: Wedell – volume: 56 start-page: 303 issue: 2 year: 2003 end-page: 331 article-title: The Core Self-Evaluations Scale: Development of a measure publication-title: Personnel Psychology contributor: fullname: Thoresen – volume: 123 start-page: 229 year: 2018 end-page: 235 article-title: Examining validity evidence for multidimensional forced choice measures with different scoring approaches publication-title: Personality and Individual Differences contributor: fullname: Stark – volume: 57 start-page: 639 issue: 3 year: 2004 end-page: 683 article-title: Applicant reactions to selection procedures: An updated model and meta-analysis publication-title: Personnel Psychology contributor: fullname: Thomas – volume: 73 start-page: 749 issue: 4 year: 1988 end-page: 751 article-title: Artifactual reliability of forced-choice scales publication-title: Journal of Applied Psychology contributor: fullname: Tenopyr – volume: 51 start-page: 345 issue: 2-3 year: 2016 end-page: 356 article-title: Thurstonian scaling of compositional questionnaire data publication-title: Multivariate Behavioral Research contributor: fullname: Brown – volume: 10 start-page: 240 issue: 3 year: 2002 end-page: 259 article-title: A comparison of ipsative and normative approaches for ability to control faking in personality questionnaires publication-title: International Journal of Organizational Analysis contributor: fullname: Hunt – volume: 29 start-page: 184 issue: 3 year: 2005 end-page: 203 article-title: An IRT approach to constructing and scoring pairwise preference items involving stimuli on different dimensions: The multi-unidimensional pairwise-preference model publication-title: Applied Psychological Measurement contributor: fullname: Drasgow – volume: 24 start-page: 351 issue: 3 year: 1998 end-page: 389 article-title: Individual values in organizations: Concepts, controversies, and research publication-title: Journal of Management contributor: fullname: Ravlin – volume: 36 start-page: 1 issue: 1 year: 2002 end-page: 31 article-title: Orthogonal markers for orthogonal factors: The case of the Big Five publication-title: Journal of Research in Personality contributor: fullname: Saucier – volume: 25 start-page: 513 issue: 4 year: 2018 end-page: 526 article-title: Forced-choice assessment of work-related maladaptive personality traits: Preliminary evidence from an application of Thurstonian item response modeling publication-title: Assessment contributor: fullname: Cooper – volume: 38 start-page: 227 issue: 2 year: 2007 end-page: 242 article-title: Development and validation of an internationally reliable short-form of the Positive and Negative Affect Schedule (PANAS) publication-title: Journal of Cross-Cultural Psychology contributor: fullname: Thompson – volume: 62 start-page: 173 issue: 1 year: 2002 end-page: 191 article-title: Development of a compact measure of job satisfaction: The abridged Job Descriptive Index publication-title: Educational and Psychological Measurement contributor: fullname: Smith – volume: 22 start-page: 105 issue: 2 year: 2009 end-page: 127 article-title: Normative scoring of multidimensional pairwise preference personality scales using IRT: Empirical comparisons with other formats publication-title: Human Performance contributor: fullname: Tuttle – volume: 19 start-page: 753 issue: 5 year: 1995 end-page: 755 article-title: The 23bb5: a new bipolar big five questionnaire publication-title: Personality and Individual Differences contributor: fullname: Diekstra – volume: 42 start-page: 1334 issue: 5 year: 2008 end-page: 1346 article-title: Personality traits and subjective health in the later years: The association between NEO-PI-R and SF-36 in advanced age is influenced by health status publication-title: Journal of Research in Personality contributor: fullname: Costa – volume: 18 start-page: 252 issue: 2 year: 2015 end-page: 275 article-title: Developing ideal intermediate personality items for the ideal point model publication-title: Organizational Research Methods contributor: fullname: Cho – volume: 17 start-page: 325 issue: 3 year: 2004 end-page: 346 article-title: Emotional stability, core self-evaluations, and job outcomes: A review of the evidence and an agenda for future research publication-title: Human Performance contributor: fullname: De Pater – volume: 49 start-page: 71 issue: 1 year: 1985 end-page: 75 article-title: The satisfaction with life scale publication-title: Journal of Personality Assessment contributor: fullname: Griffin – ident: bibr71-1094428119836486 doi: 10.1037/a0028301 – ident: bibr21-1094428119836486 doi: 10.1037/pas0000132 – ident: bibr24-1094428119836486 doi: 10.1111/j.1754-9434.2010.01273.x – ident: bibr51-1094428119836486 doi: 10.1037/0021-9010.88.5.879 – ident: bibr38-1094428119836486 doi: 10.1007/s11135-011-9640-9 – ident: bibr1-1094428119836486 doi: 10.1177/1073191114568113 – ident: bibr5-1094428119836486 doi: 10.1023/A:1007136110218 – ident: bibr81-1094428119836486 doi: 10.1093/med:psych/9780199356942.003.0024 – ident: bibr80-1094428119836486 doi: 10.1037/a0018721 – ident: bibr9-1094428119836486 doi: 10.1177/1094428116668036 – ident: bibr30-1094428119836486 doi: 10.1177/1073191116641181 – ident: bibr33-1094428119836486 doi: 10.1111/1467-9884.00122 – ident: bibr68-1094428119836486 doi: 10.1177/1094428112444611 – ident: bibr36-1094428119836486 doi: 10.1037/0021-9010.87.3.530 – ident: bibr19-1094428119836486 doi: 10.1037/1040-3590.19.1.88 – ident: bibr10-1094428119836486 doi: 10.1177/0013164410375112 – year: 2018 ident: bibr57-1094428119836486 publication-title: Assessment contributor: fullname: Sass R. – ident: bibr50-1094428119836486 doi: 10.1037/0882-7974.16.3.414 – ident: bibr82-1094428119836486 doi: 10.1177/1073191115583714 – ident: bibr23-1094428119836486 doi: 10.1007/s10869-013-9318-5 – ident: bibr60-1094428119836486 – ident: bibr73-1094428119836486 doi: 10.1037/a0015899 – ident: bibr62-1094428119836486 doi: 10.1111/j.1744-6570.1993.tb00867.x – ident: bibr75-1094428119836486 doi: 10.1177/0022022106297301 – ident: bibr29-1094428119836486 doi: 10.1111/j.1745-3984.1984.tb01039.x – year: 2012 ident: bibr87-1094428119836486 publication-title: Assessing the Tailored Adaptive Personality Assessment System (TAPAS) as an MOS qualification instrument contributor: fullname: Nye C. D. – ident: bibr2-1094428119836486 doi: 10.1177/0734282914550387 – ident: bibr53-1094428119836486 doi: 10.1177/014662169602000305 – ident: bibr12-1094428119836486 doi: 10.1080/10705511.2017.1392247 – volume-title: How to: Use the psych package for factor analysis and data reduction year: 2016 ident: bibr52-1094428119836486 contributor: fullname: Revelle W. – ident: bibr15-1094428119836486 doi: 10.1177/1094428114555993 – ident: bibr45-1094428119836486 doi: 10.1177/1094428105275374 – ident: bibr40-1094428119836486 doi: 10.1016/j.paid.2019.01.022 – volume: 64 start-page: 5830 issue: 11 year: 2003 ident: bibr48-1094428119836486 publication-title: Dissertation Abstracts International contributor: fullname: Milligan M. – ident: bibr59-1094428119836486 doi: 10.1037/0021-9010.78.6.966 – ident: bibr78-1094428119836486 doi: 10.1080/15305058.2016.1145123 – ident: bibr72-1094428119836486 – ident: bibr20-1094428119836486 doi: 10.1080/08959280902743303 – ident: bibr65-1094428119836486 doi: 10.1177/001316440206200112 – ident: bibr86-1094428119836486 doi: 10.1111/j.1365-2923.2012.04355.x – volume: 140 start-page: 1 year: 1932 ident: bibr43-1094428119836486 publication-title: Archives of Psychology contributor: fullname: Likert R. – ident: bibr26-1094428119836486 doi: 10.1177/0013164417752782 – ident: bibr67-1094428119836486 doi: 10.1037/mil0000044 – start-page: 102 volume-title: Handbook of personality: Theory and research year: 1999 ident: bibr34-1094428119836486 contributor: fullname: John O. P. – ident: bibr69-1094428119836486 doi: 10.1037/0021-9010.91.1.25 – ident: bibr32-1094428119836486 doi: 10.1037/h0029780 – ident: bibr61-1094428119836486 doi: 10.1016/j.paid.2011.07.033 – ident: bibr77-1094428119836486 doi: 10.1037/0033-2909.103.3.299 – ident: bibr35-1094428119836486 doi: 10.1111/j.1744-6570.2003.tb00152.x – ident: bibr6-1094428119836486 doi: 10.1108/eb028952 – ident: bibr8-1094428119836486 doi: 10.1080/00273171.2016.1150152 – ident: bibr85-1094428119836486 doi: 10.1037/1082-989X.1.2.170 – year: 2018 ident: bibr49-1094428119836486 publication-title: Organizational Research Methods contributor: fullname: Pavlov G. – ident: bibr42-1094428119836486 doi: 10.1016/j.paid.2017.11.031 – ident: bibr83-1094428119836486 doi: 10.1016/j.jrp.2015.12.002 – volume: 79 start-page: 281 year: 1927 ident: bibr76-1094428119836486 publication-title: Psychological Review contributor: fullname: Thurstone L. L. – ident: bibr17-1094428119836486 doi: 10.1016/j.paid.2010.06.019 – ident: bibr4-1094428119836486 doi: 10.1111/j.0965-075X.2004.282_1.x – ident: bibr63-1094428119836486 doi: 10.1037/pspp0000096 – ident: bibr25-1094428119836486 doi: 10.1037/e559902013-001 – ident: bibr37-1094428119836486 doi: 10.1207/s15327043hup1703_4 – ident: bibr28-1094428119836486 doi: 10.1037/0022-3514.59.6.1216 – ident: bibr3-1094428119836486 doi: 10.1111/j.1468-2389.2007.00386.x – volume-title: Paper presented at the American Psychological Association year: 1946 ident: bibr55-1094428119836486 contributor: fullname: Rundquist E. A. – ident: bibr74-1094428119836486 doi: 10.1037/0021-9010.73.4.749 – volume-title: Journal of Applied Psychology ident: bibr14-1094428119836486 contributor: fullname: Cao M. – ident: bibr16-1094428119836486 doi: 10.1080/15305058.2017.1345913 – ident: bibr7-1094428119836486 doi: 10.1007/s11336-014-9434-9 – ident: bibr31-1094428119836486 doi: 10.1111/j.1744-6570.2004.00003.x – ident: bibr27-1094428119836486 doi: 10.1016/0191-8869(95)00119-Q – ident: bibr79-1094428119836486 doi: 10.1177/00131649921969802 – ident: bibr11-1094428119836486 doi: 10.1037/a0030641 – year: 2018 ident: bibr41-1094428119836486 publication-title: Applied Psychological Measurement contributor: fullname: Lee P. – ident: bibr47-1094428119836486 doi: 10.1177/014920639802400304 – ident: bibr18-1094428119836486 doi: 10.1037/met0000101 – ident: bibr39-1094428119836486 doi: 10.1037/0033-2909.87.1.72 – ident: bibr54-1094428119836486 doi: 10.1177/00131649921969811 – ident: bibr64-1094428119836486 doi: 10.2307/1412159 – ident: bibr70-1094428119836486 doi: 10.1037/0033-2909.134.1.138 – ident: bibr66-1094428119836486 doi: 10.1177/0146621604273988 – ident: bibr22-1094428119836486 doi: 10.1207/s15327752jpa4901_13 – ident: bibr13-1094428119836486 publication-title: Educational and Psychological Measurement contributor: fullname: Bürkner P. C. – ident: bibr58-1094428119836486 doi: 10.1006/jrpe.2001.2335 – ident: bibr44-1094428119836486 doi: 10.1016/j.jrp.2008.05.006 |
| SSID | ssj0013259 |
| Score | 2.482298 |
| Snippet | Forced-choice (FC) measures are gaining popularity as an alternative assessment format to single-statement (SS) measures. However, a fundamental question... |
| SourceID | proquest crossref sage |
| SourceType | Aggregation Database Publisher |
| StartPage | 569 |
| SubjectTerms | Equivalence Format Organization theory |
| Title | Though Forced, Still Valid: Psychometric Equivalence of Forced-Choice and Single-Statement Measures |
| URI | https://journals.sagepub.com/doi/full/10.1177/1094428119836486 https://www.proquest.com/docview/2407537461 |
| Volume | 23 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1bb9MwFLZKJyFeEFdRGMgPCAkVj6a265S3MVZNSOWibmg8VbHjbmUlgSR9YL-HH8rxJYlXNonxEkWparc-X-zvHJ_jD6HnXGgqaSrIgmlGWKwTIoepIkImNB1JqsZWDGb6YXRwxN4f8-NO53eQtbSu5I46v7Su5H-sCs_ArqZK9hqWbRqFB3AP9oUrWBiu_2hjq7EzyQvlYpazarla9b8At7bSzW52-25Es1R__-d6CZ3bNxkYovsS2TvNl75mYAar2EoTSz9tisDUxQ_LkMCGtZtWE8CHTZwSdUPQmzj027zddnJCyIDHb-sGku-KpDxx-0uTYlmdt-kGush-lac6O7PB3I8rfVbCryz6s50wUgFuaZ3VWk-u4EoScHfcI-0nXA4Mn7ni53pGdhXIHnk0mF65k3XxKzV3QqN_LwJ2G9r0ZjqLxjEdscvO295YB5vsxMgfgb7Zwg20ZY5bZF20tfv10-dpsFtlRfma_9duh7_ebOMi_Wl9miCN0DKbwzvotndJ8K7D113U0dk9dLOuiLiPlIMZdoh5hS3IsAXZGxxCDAcQw_kCX4AYBuPhTYjhGmIP0NFk_3DvgHhtDqLYIK5IorRKUvBHuRwPE7qgVAohUxZTCnRHD1PB9FgsBkoLI4EAXEkOzFGRsAAwbiaBh6ib5Zl-hHAqYKTSZKB1pBiP4E4CZ0pgwATlccx76GU9ZPMf7giW-VUm6qHtekzn_kUt5yZowalgo6iHXphxbj-6qp3H1-jzCbrVon0bdatirZ8CU63kMw-UP0BAjHs |
| link.rule.ids | 314,780,784,27924,27925 |
| linkProvider | SAGE Publications |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Though+Forced%2C+Still+Valid%3A+Psychometric+Equivalence+of+Forced-Choice+and+Single-Statement+Measures&rft.jtitle=Organizational+research+methods&rft.au=Zhang%2C+Bo&rft.au=Sun%2C+Tianjun&rft.au=Drasgow%2C+Fritz&rft.au=Chernyshenko%2C+Oleksandr+S.&rft.date=2020-07-01&rft.issn=1094-4281&rft.eissn=1552-7425&rft.volume=23&rft.issue=3&rft.spage=569&rft.epage=590&rft_id=info:doi/10.1177%2F1094428119836486&rft.externalDBID=n%2Fa&rft.externalDocID=10_1177_1094428119836486 |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1094-4281&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1094-4281&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1094-4281&client=summon |