Reliability and the ACTFL Oral Proficiency Interview: Reporting Indices of Interrater Consistency and Agreement for 19 Languages

: The reliability of the ACTFL Oral Proficiency Interview (OPI) has not been reported since ACTFL revised its speaking proficiency guidelines in 1999. Reliability data for assessments should be reported periodically to provide users with enough information to evaluate the psychometric characteristic...

Full description

Saved in:
Bibliographic Details
Published inForeign language annals Vol. 36; no. 4; pp. 507 - 519
Main Authors Surface, Eric A., Dierdorff, Erich C.
Format Journal Article
LanguageEnglish
Published Oxford, UK Blackwell Publishing Ltd 01.12.2003
American Council on the Teaching of Foreign Languages
Subjects
Online AccessGet full text

Cover

Loading…
More Information
Summary:: The reliability of the ACTFL Oral Proficiency Interview (OPI) has not been reported since ACTFL revised its speaking proficiency guidelines in 1999. Reliability data for assessments should be reported periodically to provide users with enough information to evaluate the psychometric characteristics of the assessment. This study provided the most comprehensive analysis of ACTFL OPI reliability to date, reporting interrater consistency and agreement data for 19 different languages. Overall, the interrater reliability of the ACTFL OPI was found to be very high. These results demonstrate the importance of using an OPI assessment program that has a well‐designed interview process, a well‐articulated set of criteria for proficiency determination, a solid rater training program, and an experienced cadre of testers. Based on the data reported, educators and employers who use the ACTFL OPI can expect reliable results and use the scores generated from the testing process with increased confidence. Recommendations for future research are discussed.
Bibliography:ark:/67375/WNG-HNGQ5TB1-0
ArticleID:FLAN507
istex:679B8848D164001A81519CF139F9E2D709A8493A
Eric A. Surface (PhD, North Carolina State University) is a principal and researcher with Surface, Ward & Associates, an organizational consulting and research firm based in Raleigh, North Carolina, and serves as the Director of Training Research for the Special Operations Forces Language Office, Ft. Bragg, North Carolina, as part of his fellowship with the Army Research Institute's Consortium Research Fellows Program.
Erich C. Dierdorff (PhD, North Carolina State University) is a Visiting Professor in the College of Commerce at DePaul University and a Consortium Research Fellow with the Army Research Institute, Ft. Bragg, North Carolina.
ObjectType-Article-1
SourceType-Scholarly Journals-1
ObjectType-Feature-2
content type line 23
ISSN:0015-718X
1944-9720
DOI:10.1111/j.1944-9720.2003.tb02140.x