The effect of viewing visual cues in a listening comprehension test on second language learners’ test-taking process and performance: An eye-tracking study

• Published in: Language testing Vol. 41; no. 3; pp. 649 - 680
• Main Authors: Kwon, Suh Keong, Yu, Guoxing
• Format: Journal Article
• Language: English
• Published: London, England SAGE Publications 01.07.2024; Sage Publications Ltd
• Subjects: Cues; English as a second language learning; Eye movements; Language tests; Listening; Listening comprehension; Listening Comprehension Tests; Motor Reactions; Second Language Learning; Test Items; Video Technology; South Korea; test takers’ interaction with visual cues; video-based listening test; Eye-tracking method; L2 listening assessment; stimulated-recall interview
• ISSN: 0265-5322; 1477-0946
• DOI: 10.1177/02655322241239356

In this study, we examined the effect of visual cues in a second language listening test on test takers’ viewing behaviours and their test performance. Fifty-seven learners of English in Korea took a video-based listening test, with their eye movements recorded, and 23 of them were interviewed individually after the test. The participants viewed the visual cues longer than the items in the multiple-choice questions. Looking at the correct answer choice was related to a higher test score, while looking at the speaker(s) in the video and the distractors of the test items to a lower test score. Viewing the PowerPoint slides showed mixed effects on test performance, depending on different eye-movement measures. Stimulated-recall interviews shed further light on the possible reasons for the different patterns of the participants’ eye movements. Overall, the participants held the positive view that the visual cues aided them in comprehending the aural input and in completing the listening tasks more successfully. We discuss these findings in relation to the authenticity of tasks and the construct relevance of video-based listening tests.