The validation crisis in the L2 motivational self system tradition

• Published in: Studies in Second Language Acquisition Vol. 46; no. 2; pp. 307 - 329
• Main Authors: Al-Hoorie, Ali H., Hiver, Phil, In’nami, Yo
• Format: Journal Article
• Language: English
• Published: New York, USA Cambridge University Press 01.05.2024; Cambridge University Press (CUP)
• Subjects: Beliefs; Coding; Construct Validity; Discriminant analysis; Emotional intelligence; English as a second language learning; English language learners; Factor Analysis; Hypothesis testing; Inferences; Korean language; Learning Experience; Measurement Techniques; Motivation; Psychometrics; Second Language Learning; Self concept; Student attitudes; Test Interpretation; Validation studies; Validity
• ISSN: 0272-2631; 1470-1545
• DOI: 10.1017/S0272263123000487

Concerns have recently been raised about the validity of scales used in the L2 motivational self system tradition, particularly in relation to sufficient discriminant validity among some of its scales. These concerns highlight the need to systematically examine the validity of scales used in this tradition. In this study, we therefore compiled a list of 18 scales in widespread use and administered them to Korean learners of English (N = 384). Testing the factorial structure of these scales using multiple exploratory and confirmatory factor-analytic criteria revealed severe discriminant validity issues. For example, the ideal L2 self was not discriminant from linguistic self-confidence, suggesting that participant responses to such ideal L2 self items is not driven by actual–ideal discrepancies as previously presumed but more likely by self-efficacy beliefs. We discuss these results in the context of the need to encourage systematic psychometric validation research in the language motivation field.