Evaluating evidence for the reliability and validity of lexical diversity indices in L2 oral task responses
Although lexical diversity is often used as a measure of productive proficiency (e.g., as an aspect of lexical complexity) in SLA studies involving oral tasks, relatively little research has been conducted to support the reliability and/or validity of these indices in spoken contexts. Furthermore, S...
Saved in:
| Published in | Studies in second language acquisition Vol. 46; no. 1; pp. 278 - 299 |
|---|---|
| Main Authors | , , , |
| Format | Journal Article |
| Language | English |
| Published |
New York, USA
Cambridge University Press
01.03.2024
|
| Subjects | |
| Online Access | Get full text |
| ISSN | 0272-2631 1470-1545 |
| DOI | 10.1017/S0272263123000402 |
Cover
Loading…
| Abstract | Although lexical diversity is often used as a measure of productive proficiency (e.g., as an aspect of lexical complexity) in SLA studies involving oral tasks, relatively little research has been conducted to support the reliability and/or validity of these indices in spoken contexts. Furthermore, SLA researchers commonly use indices of lexical diversity such as Root TTR (Guiraud’s index) and D (vocd-D and HD-D) that have been preliminarily shown to lack reliability in spoken L2 contexts and/or have been consistently shown to lack reliability in written L2 contexts. In this study, we empirically evaluate lexical diversity indices with respect to two aspects of reliability (text-length independence and across-task stability) and one aspect of validity (relationship with proficiency scores). The results indicated that neither Root TTR nor D is reliable across different text lengths. However, support for the reliability and validity of optimized versions of MATTR and MTLD was found. |
|---|---|
| AbstractList | Although lexical diversity is often used as a measure of productive proficiency (e.g., as an aspect of lexical complexity) in SLA studies involving oral tasks, relatively little research has been conducted to support the reliability and/or validity of these indices in spoken contexts. Furthermore, SLA researchers commonly use indices of lexical diversity such as Root TTR (Guiraud’s index) and D (vocd-D and HD-D) that have been preliminarily shown to lack reliability in spoken L2 contexts and/or have been consistently shown to lack reliability in written L2 contexts. In this study, we empirically evaluate lexical diversity indices with respect to two aspects of reliability (text-length independence and across-task stability) and one aspect of validity (relationship with proficiency scores). The results indicated that neither Root TTR nor D is reliable across different text lengths. However, support for the reliability and validity of optimized versions of MATTR and MTLD was found. Although lexical diversity is often used as a measure of productive proficiency (e.g., as an aspect of lexical complexity) in SLA studies involving oral tasks, relatively little research has been conducted to support the reliability and/or validity of these indices in spoken contexts. Furthermore, SLA researchers commonly use indices of lexical diversity such as Root TTR (Guiraud’s index) and D (vocd-D and HD-D) that have been preliminarily shown to lack reliability in spoken L2 contexts and/or have been consistently shown to lack reliability in written L2 contexts. In this study, we empirically evaluate lexical diversity indices with respect to two aspects of reliability (text-length independence and across-task stability) and one aspect of validity (relationship with proficiency scores). The results indicated that neither Root TTR nor D is reliable across different text lengths. However, support for the reliability and validity of optimized versions of MATTR and MTLD was found. |
| Author | Eguchi, Masaki Sung, Hakyung Zenker, Fred Kyle, Kristopher |
| Author_xml | – sequence: 1 givenname: Kristopher orcidid: 0000-0001-5415-9672 surname: Kyle fullname: Kyle, Kristopher email: kkyle2@uoregon.edu organization: 1Department of Linguistics, University of Oregon, Eugene, OR, USA – sequence: 2 givenname: Hakyung surname: Sung fullname: Sung, Hakyung organization: 1Department of Linguistics, University of Oregon, Eugene, OR, USA – sequence: 3 givenname: Masaki orcidid: 0000-0002-0791-4935 surname: Eguchi fullname: Eguchi, Masaki organization: 1Department of Linguistics, University of Oregon, Eugene, OR, USA – sequence: 4 givenname: Fred orcidid: 0000-0002-1620-6690 surname: Zenker fullname: Zenker, Fred organization: 2Department of Second Language Studies, University of Hawaii at Manoa, Honolulu, HI, USA |
| BookMark | eNp9kF9LwzAUxYMouE0_gG8Bn6tJ2jTto4z5BwY-qM8lbW5mti6ZSTbctzdlA0HRp8u95_xOwhmjU-ssIHRFyQ0lVNy-ECYYK3PKckJIQdgJGtFCkIzygp-i0SBng36OxiEsk6cUIh-h1Wwn-62Mxi4w7IwC2wHWzuP4DthDb2RrehP3WFqFk9WoYXEa9_BpOtljZXbgw3A0VpkOQpp4zrDzSYwyrFJK2DgbIFygMy37AJfHOUFv97PX6WM2f354mt7Nsy6nImZlVZeC5KTjlPO61m2lgArFtBSkLCnlQihZMZBcaNLWlGjdcs011FqxqmD5BF0fcjfefWwhxGbptt6mJxtWV5yLmqf8CaIHV-ddCB50s_FmLf2-oaQZOm1-dZoY8YPpTEzlORu9NP2_ZH4k5br1Ri3g-1N_U19p5ouf |
| CitedBy_id | crossref_primary_10_1007_s11192_025_05258_6 crossref_primary_10_3390_languages9080266 crossref_primary_10_1007_s10489_024_05399_w crossref_primary_10_1080_15434303_2024_2311728 crossref_primary_10_1016_j_rmal_2024_100168 crossref_primary_10_1016_j_rmal_2023_100085 crossref_primary_10_1093_applin_amae053 crossref_primary_10_1016_j_lingua_2024_103854 |
| Cites_doi | 10.1558/isla.38247 10.1016/1060-3743(95)90004-7 10.1093/applin/amac003 10.1177/0265532217710632 10.1016/j.jslw.2012.03.007 10.1016/j.system.2017.03.007 10.37546/JALTJJ34.1-2 10.1111/j.1467-9922.2012.00739.x 10.1016/j.system.2012.10.012 10.1057/9780230511804 10.1177/1362168818817945 10.1075/sibil.47.05ch3 10.1075/scl.78.05tra 10.1037/h0093511 10.1111/modl.12666 10.1017/CBO9780511732942 10.1111/lang.12232 10.5054/tq.2011.244483 10.1044/2015_JSLHR-L-14-0280 10.1093/applin/amp044 10.1093/applin/amv002 10.1191/0265532202lt220oa 10.1177/0265532207080767 10.1002/j.2330-8516.1985.tb00106.x 10.1111/modl.12468 10.1017/S0267190521000039 10.1016/j.jslw.2003.09.001 10.1080/15434303.2020.1844205 10.1080/09296171003643098 10.1044/jshr.2901.129 10.18637/jss.v067.i01 10.1177/0265532215587391 10.1016/j.system.2020.102246 10.1111/j.1540-4781.2011.01232_1.x 10.1075/bpa.13.10koi 10.1023/A:1001749303137 10.1093/applin/amm017 10.1111/jedm.12000 10.1016/j.asw.2020.100505 10.1037/h0093508 10.3758/BRM.42.2.381 10.1016/j.asw.2005.02.001 10.1177/02655322211057868 10.1093/applin/amt013 |
| ContentType | Journal Article |
| Copyright | The Author(s), 2023. Published by Cambridge University Press |
| Copyright_xml | – notice: The Author(s), 2023. Published by Cambridge University Press |
| DBID | AAYXX CITATION 0-V 3V. 7T9 7XB 88B 88G 8A4 8FI 8FJ 8FK ABUWG AFKRA AHOVV AIMQZ ALSLI AZQEC BENPR CCPQU CJNVE CPGLG CRLPW DWQXO FYUFA GHDGH GNUQQ LIQON M0P M2M PHGZM PHGZT PKEHL PMKZF PQEDU PQEST PQQKQ PQUKI PRQQA PSYQQ Q9U |
| DOI | 10.1017/S0272263123000402 |
| DatabaseName | CrossRef ProQuest Social Sciences Premium Collection【Remote access available】 ProQuest Central (Corporate) Linguistics and Language Behavior Abstracts (LLBA) ProQuest Central (purchase pre-March 2016) Education Database (Alumni Edition) Psychology Database (Alumni) Education Periodicals Hospital Premium Collection Hospital Premium Collection (Alumni Edition) ProQuest Central (Alumni) (purchase pre-March 2016) ProQuest Central (Alumni) ProQuest Central UK/Ireland Education Research Index ProQuest One Literature Social Science Premium Collection ProQuest Central Essentials ProQuest Central ProQuest One Education Collection Linguistics Collection Linguistics Database (ProQuest) ProQuest Central Health Research Premium Collection Health Research Premium Collection (Alumni) ProQuest Central Student ProQuest One Literature Education Database Psychology Database ProQuest Central Premium ProQuest One Academic (New) ProQuest One Academic Middle East (New) ProQuest Digital Collections ProQuest One Education ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest One Social Sciences ProQuest One Psychology ProQuest Central Basic |
| DatabaseTitle | CrossRef ProQuest One Education ProQuest One Psychology ProQuest Central Student ProQuest One Academic Middle East (New) ProQuest Central Essentials ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest Central Linguistics Collection Health Research Premium Collection ProQuest Central Korea ProQuest Central (New) Social Science Premium Collection ProQuest One Literature - U.S. Customers Only Education Collection ProQuest One Social Sciences ProQuest Central Basic ProQuest One Literature ProQuest Education Journals ProQuest One Academic Eastern Edition Linguistics and Language Behavior Abstracts (LLBA) ProQuest Hospital Collection Health Research Premium Collection (Alumni) ProQuest Psychology Journals (Alumni) ProQuest Professional Education ProQuest Hospital Collection (Alumni) ProQuest Digital Collections ProQuest Psychology Journals ProQuest Social Sciences Premium Collection ProQuest One Academic UKI Edition Linguistics Database ProQuest One Academic ProQuest Education Journals (Alumni Edition) ProQuest Central (Alumni) ProQuest One Academic (New) |
| DatabaseTitleList | ProQuest One Education CrossRef |
| Database_xml | – sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database |
| DeliveryMethod | fulltext_linktorsrc |
| Discipline | Languages & Literatures |
| EISSN | 1470-1545 |
| EndPage | 299 |
| ExternalDocumentID | 10_1017_S0272263123000402 |
| GroupedDBID | --Z -1C -1D -1E -2P -2R -E. -~6 -~X .FH 0-V 09C 09D 0E1 0R~ 123 29Q 2FS 3R3 3V. 4.4 5VS 63O 6TJ 6~7 6~8 74X 74Z 7~U 7~V 8A4 8FI 8FJ 8I0 8R4 8R5 9M5 AABES AABWE AACJH AADNG AAEED AAGFV AAKTX AALKF AAPYI AARAB AASVR AAUKB AAYOK ABBHK ABBXD ABGDZ ABITZ ABIVO ABJNI ABJWI ABKAW ABQWD ABROB ABTCQ ABTME ABTND ABUWG ABVFV ABXAU ABXSQ ABZCX ABZUI ACABY ACBNA ACCHT ACGFO ACGFS ACHDO ACHQT ACIMK ACMRT ACNCT ACQFJ ACREK ACUIJ ACUYZ ACWGA ACYZP ACZBM ACZBN ADACV ADBBV ADBZK ADFEC ADFRT ADGEJ ADKIL ADNWM ADOCW ADOVH ADTCA ADULT ADVJH AEBAK AEBPU AEFOJ AEHFS AEHGV AEUPB AEYYC AFFUJ AFKQG AFKRA AFKRZ AFKSM AFLVW AFUTZ AGABE AGHGI AGJUD AGLWM AGOOT AHQXX AHRGI AIDRF AIGNW AIHIV AIKWM AIMQZ AISIE AJ7 AJPFC AJQAS AKZCZ ALMA_UNASSIGNED_HOLDINGS ALSLI ALVPG ANFVQ AOWSX ARABE ARALO ARZZG ATUCA AUXHV AVDNQ AWRMI AWSUU AYIQA AZQEC BBLKV BBQHK BENPR BGHMG BJBOZ BMAJL BPHCQ BQFHP BVXVI C0O CAG CCPQU CCQAD CCUQV CDIZJ CFAFE CFBFF CFLAC CGMFO CHEAL CJCSC CJNVE COF CPGLG CRLPW CRVLH CS3 DC4 DOHLZ DU5 DWQXO EBS ED0 EGQIC EJD F20 FYUFA G8K GDOGT GNUQQ HG- HOVLH HSS HST HZ~ I.5 I.7 I.8 IH6 IOEEP IOO IS6 I~P J36 J38 J3B JAAYA JBMMH JENOY JHFFW JHPGK JKQEH JLEZI JLXEF JOSPZ JPL JPPIE JQKCU JRMXA JSODD JST KAFGG KC5 L98 LIQON LW7 M-V M0P M2M M7~ M8. NEJ NHB NIKVX NNXVD O9- OHT OYBOY P2P PQQKQ PROAC PSYQQ Q2X RCA RIG ROL RR0 S6- S6U SA0 T9M TN5 UHB UKHRP UT1 WFFJZ WH7 WHG WQ3 WXS WXY WYF WYP XDASD XFK XIH XOL YNT ZCA ZJOSE ZMEZD ZYDXJ ~A4 AAKNA AATMM AAYXX ABDPE ABHFL ABVKB ABXHF ACDLN ACEJA ACOZI ACRPL ADMHG ADNMO AELHJ AEMFK AFOWJ AFZFC AGQPQ AGTDA AKMAY ALIPV ANOYL CBIIA CITATION IPSME MLAFT PHGZM PHGZT PMKZF PQEDU 7T9 7XB 8FK AAWJA AHOVV PKEHL PQEST PQUKI PRQQA Q9U |
| ID | FETCH-LOGICAL-c317t-68967030c515599fb8de17d2fa706611577da82ea57f0b910ffb5f5fe9fd28423 |
| IEDL.DBID | BENPR |
| ISSN | 0272-2631 |
| IngestDate | Sat Aug 23 14:20:30 EDT 2025 Tue Jul 01 02:42:57 EDT 2025 Thu Apr 24 22:58:30 EDT 2025 Wed Mar 27 02:11:37 EDT 2024 |
| IsPeerReviewed | true |
| IsScholarly | true |
| Issue | 1 |
| Language | English |
| LinkModel | DirectLink |
| MergedId | FETCHMERGED-LOGICAL-c317t-68967030c515599fb8de17d2fa706611577da82ea57f0b910ffb5f5fe9fd28423 |
| Notes | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 14 |
| ORCID | 0000-0001-5415-9672 0000-0002-1620-6690 0000-0002-0791-4935 |
| PQID | 2985579570 |
| PQPubID | 47701 |
| PageCount | 22 |
| ParticipantIDs | proquest_journals_2985579570 crossref_primary_10_1017_S0272263123000402 crossref_citationtrail_10_1017_S0272263123000402 cambridge_journals_10_1017_S0272263123000402 |
| ProviderPackageCode | CITATION AAYXX |
| PublicationCentury | 2000 |
| PublicationDate | 2024-03-01 |
| PublicationDateYYYYMMDD | 2024-03-01 |
| PublicationDate_xml | – month: 03 year: 2024 text: 2024-03-01 day: 01 |
| PublicationDecade | 2020 |
| PublicationPlace | New York, USA |
| PublicationPlace_xml | – name: New York, USA – name: New York |
| PublicationTitle | Studies in second language acquisition |
| PublicationTitleAlternate | Stud Second Lang Acquis |
| PublicationYear | 2024 |
| Publisher | Cambridge University Press |
| Publisher_xml | – name: Cambridge University Press |
| References | 2021; 47 2015; 58 2019; 3 2002; 19 2010; 17 2018; 102 2017; 66 2017; 67 2013; 63 2020; 104 2022; 43 1995; 4 2012; 34 2016; 37 1944; 56 2012; 96 2003; 12 2016; 33 2015; 67 2010; 42 2018; 39 2009; 30 2017; 38 2008; 29 2021; 18 2013; 50 2020; 91 2004; 12 2017; 34 1985; 1985 2016; 20 1986; 29 2005; 10 2014; 35 2020; 24 2011; 45 1971; 2 2021; 41 1998; 32 2007; 24 2012; 21 2022; 39 2012; 40 S0272263123000402_r39 S0272263123000402_r38 Cohen (S0272263123000402_r67) 1988 S0272263123000402_r37 S0272263123000402_r1 Geertzen (S0272263123000402_r18) 2014 S0272263123000402_r2 S0272263123000402_r3 S0272263123000402_r4 S0272263123000402_r5 S0272263123000402_r7 S0272263123000402_r8 S0272263123000402_r9 S0272263123000402_r32 S0272263123000402_r30 S0272263123000402_r36 Izumi (S0272263123000402_r24) 2004; 12 S0272263123000402_r35 S0272263123000402_r34 S0272263123000402_r33 S0272263123000402_r29 S0272263123000402_r28 S0272263123000402_r27 S0272263123000402_r26 Chapelle (S0272263123000402_r11) 2008 Révész (S0272263123000402_r54) 2016; 37 Biber (S0272263123000402_r6) 2004 S0272263123000402_r61 S0272263123000402_r60 S0272263123000402_r21 S0272263123000402_r65 S0272263123000402_r20 S0272263123000402_r64 S0272263123000402_r63 Guiraud (S0272263123000402_r19) 1960 S0272263123000402_r62 S0272263123000402_r25 S0272263123000402_r23 S0272263123000402_r66 S0272263123000402_r17 S0272263123000402_r16 S0272263123000402_r15 Maas (S0272263123000402_r44) 1971; 2 Malvern (S0272263123000402_r46) 1997; 12 S0272263123000402_r50 S0272263123000402_r10 S0272263123000402_r53 S0272263123000402_r52 S0272263123000402_r51 S0272263123000402_r14 S0272263123000402_r58 S0272263123000402_r57 S0272263123000402_r13 S0272263123000402_r56 S0272263123000402_r12 S0272263123000402_r49 S0272263123000402_r48 Ishikawa (S0272263123000402_r22) 2011 Kobayashi (S0272263123000402_r31) 2016; 20 Tracy-Ventura (S0272263123000402_r55) 2021 Lennon (S0272263123000402_r41) 2000 S0272263123000402_r43 S0272263123000402_r42 S0272263123000402_r40 S0272263123000402_r47 Treffers-Daller (S0272263123000402_r59) 2018; 39 S0272263123000402_r45 |
| References_xml | – volume: 12 start-page: 119 year: 2004 end-page: 125 article-title: The NICT JLE Corpus: Exploiting the language learners’ speech database for research and education publication-title: International Journal of The Computer, the Internet and Management – volume: 104 start-page: 662 year: 2020 end-page: 686 article-title: The dynamic multicausality of age of first bilingual language exposure: Evidence from a longitudinal content and language integrated learning study with dense time serial measurements publication-title: The Modern Language Journal – volume: 12 start-page: 377 year: 2003 end-page: 403 article-title: Exploring multiple profiles of highly rated learner compositions publication-title: Journal of Second Language Writing – volume: 34 start-page: 35 year: 2012 end-page: 60 article-title: Comparing the story retelling speaking test with other speaking tests publication-title: JALT Journal – volume: 43 start-page: 746 year: 2022 end-page: 775 article-title: How ready are Indian primary school children for English medium instruction? An analysis of the relationship between the reading skills of low-SES children, their oral vocabulary and English input in the classroom in government schools in India publication-title: Applied Linguistics – volume: 21 start-page: 239 year: 2012 end-page: 263 article-title: A dynamic usage based perspective on L2 writing publication-title: Journal of Second Language Writing – volume: 40 start-page: 554 year: 2012 end-page: 564 article-title: Effects of text length on lexical diversity measures: Using short texts with less than 200 tokens publication-title: System – volume: 35 start-page: 184 year: 2014 end-page: 207 article-title: Dynamics of complexity and accuracy: A longitudinal case study of advanced untutored development publication-title: Applied Linguistics – volume: 67 start-page: 180 year: 2017 end-page: 208 article-title: Task effects on linguistic complexity and accuracy: A large-scale learner corpus analysis employing natural language processing techniques publication-title: Language Learning – volume: 41 start-page: 76 year: 2021 end-page: 94 article-title: Lexical diversity development in newly arrived parent-child immigrant pairs: Aptitude, age, exposure, and anxiety publication-title: Annual Review of Applied Linguistics – volume: 96 start-page: 190 year: 2012 end-page: 208 article-title: The relationship of lexical richness to the quality of ESL learners’ oral narratives publication-title: The Modern Language Journal – volume: 3 start-page: 153 year: 2019 end-page: 180 article-title: Beginning L2 complexity development in CLIL and non-CLIL secondary education publication-title: Instructed Second Language Acquisition – volume: 4 start-page: 139 year: 1995 end-page: 155 article-title: The relationship of lexical proficiency to the quality of ESL compositions publication-title: Journal of Second Language Writing – volume: 20 start-page: 55 year: 2016 end-page: 73 article-title: Automated scoring of L2 spoken English with random forests publication-title: Journal of Pan-Pacific Association of Applied Linguistics – volume: 66 start-page: 130 year: 2017 end-page: 141 article-title: Linguistic complexity in L2 writing revisited: Issues of topic, proficiency, and construct multidimensionality publication-title: System – volume: 29 start-page: 129 year: 1986 end-page: 134 article-title: Sample size and type-token ratios for oral language of preschool children publication-title: Journal of Speech, Language, and Hearing Research – volume: 29 start-page: 24 year: 2008 end-page: 49 article-title: Assessed levels of second language speaking proficiency: How distinct? publication-title: Applied Linguistics – volume: 39 start-page: 618 year: 2022 end-page: 648 article-title: Register variation in spoken and written language use across technology-mediated and non-technology-mediated learning environments publication-title: Language Testing – volume: 58 start-page: 840 year: 2015 end-page: 852 article-title: Psychometric evaluation of lexical diversity indices: Assessing length effects publication-title: Journal of Speech, Language, and Hearing Research – volume: 24 start-page: 568 year: 2020 end-page: 587 article-title: Effects of English-medium instruction on Spanish students’ proficiency and lexical diversity in English publication-title: Language Teaching Research – volume: 63 start-page: 87 year: 2013 end-page: 106 article-title: Capturing the diversity in lexical diversity publication-title: Language Learning – volume: 102 start-page: 333 year: 2018 end-page: 349 article-title: Measuring syntactic complexity in L2 writing using fine-grained clausal and phrasal indices publication-title: The Modern Language Journal – volume: 30 start-page: 555 year: 2009 end-page: 578 article-title: Towards an organic approach to investigating CAF in instructed SLA: The case of complexity publication-title: Applied Linguistics – volume: 56 start-page: 75 year: 1944 end-page: 111 article-title: Studies in language behavior IV: A statistical and comparative analysis of individual written language samples publication-title: Psychological Monographs – volume: 19 start-page: 57 year: 2002 end-page: 84 article-title: Short texts, best-fitting curves and new measures of lexical diversity publication-title: Language Testing – volume: 33 start-page: 319 year: 2016 end-page: 340 article-title: Construct validity in TOEFL iBT speaking tasks: Insights from natural language processing publication-title: Language Testing – volume: 34 start-page: 537 year: 2017 end-page: 553 article-title: Grounding lexical diversity in human judgments publication-title: Language Testing – volume: 91 year: 2020 article-title: Investigating the interrelationship between rated L2 proficiency and linguistic complexity in L2 speech publication-title: System – volume: 37 start-page: 828 year: 2016 end-page: 848 article-title: The effects of complexity, accuracy, and fluency on communicative adequacy in oral task performance publication-title: Applied Linguistics – volume: 47 year: 2021 article-title: Investigating minimum text lengths for lexical diversity indices publication-title: Assessing Writing – volume: 2 start-page: 73 year: 1971 end-page: 96 article-title: Über den Zusammenhang zwischen Wortschatzumfang und Länge eines Textes [On the connection between vocabulary breadth and text length] publication-title: Zeitschrift Für Literaturwissenschaft Und Linguistik – volume: 42 start-page: 381 year: 2010 end-page: 392 article-title: MTLD, vocd-D, and HD-D: A validation study of sophisticated approaches to lexical diversity assessment publication-title: Behavior Research Methods – volume: 67 start-page: 1 year: 2015 end-page: 48 article-title: Fitting linear mixed-effects models using lme4 publication-title: Journal of Statistical Software – volume: 38 start-page: 90 year: 2017 end-page: 111 article-title: The development of complexity, accuracy, and fluency in second language performance: A longitudinal study publication-title: Applied Linguistics – volume: 56 start-page: 1 year: 1944 end-page: 15 article-title: Studies in language behavior I: A program of research publication-title: Psychological Monographs – volume: 18 start-page: 154 year: 2021 end-page: 170 article-title: Assessing the validity of lexical diversity indices using direct judgements publication-title: Language Assessment Quarterly – volume: 32 start-page: 323 year: 1998 end-page: 352 article-title: How variable may a constant be? Measures of lexical richness in perspective publication-title: Computers and the Humanities – volume: 24 start-page: 459 year: 2007 end-page: 488 article-title: vocd: A theoretical and empirical evaluation publication-title: Language Testing – volume: 50 start-page: 1 year: 2013 end-page: 73 article-title: Validating the interpretations and uses of test scores publication-title: Journal of Educational Measurement – volume: 17 start-page: 94 year: 2010 end-page: 100 article-title: Cutting the Gordian knot: The moving-average type–token ratio (MATTR) publication-title: Journal of Quantitative Linguistics – volume: 10 start-page: 5 year: 2005 end-page: 43 article-title: Differences in written discourse in independent and integrated prototype tasks for next generation TOEFL publication-title: Assessing Writing – volume: 45 start-page: 5 year: 2011 end-page: 35 article-title: Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? publication-title: TESOL Quarterly – volume: 39 start-page: 302 year: 2018 end-page: 327 article-title: Back to basics: How measures of lexical diversity can help discriminate between CEFR levels publication-title: Applied Linguistics – volume: 1985 start-page: 137 year: 1985 article-title: Relationship of admission test scores to writing performance of native and nonnative speakers of English publication-title: ETS Research Report Series – ident: S0272263123000402_r8 doi: 10.1558/isla.38247 – start-page: 3 volume-title: Corpora and language technologies in teaching, learning and research year: 2011 ident: S0272263123000402_r22 – ident: S0272263123000402_r15 doi: 10.1016/1060-3743(95)90004-7 – ident: S0272263123000402_r58 doi: 10.1093/applin/amac003 – ident: S0272263123000402_r27 doi: 10.1177/0265532217710632 – ident: S0272263123000402_r62 doi: 10.1016/j.jslw.2012.03.007 – ident: S0272263123000402_r64 doi: 10.1016/j.system.2017.03.007 – volume-title: Building a validity argument for the Test of English as a Foreign Language year: 2008 ident: S0272263123000402_r11 – ident: S0272263123000402_r32 doi: 10.37546/JALTJJ34.1-2 – volume-title: Representing language use in the university: Analysis of the TOEFL 2000 Spoken and Written Academic Language corpus year: 2004 ident: S0272263123000402_r6 – ident: S0272263123000402_r21 – start-page: 25 volume-title: Perspectives on fluency year: 2000 ident: S0272263123000402_r41 – volume: 12 start-page: 58 volume-title: Evolving models of language year: 1997 ident: S0272263123000402_r46 – start-page: 148 volume-title: Learner corpus research meets second language acquisition year: 2021 ident: S0272263123000402_r55 – ident: S0272263123000402_r26 doi: 10.1111/j.1467-9922.2012.00739.x – ident: S0272263123000402_r66 – ident: S0272263123000402_r45 – ident: S0272263123000402_r35 – ident: S0272263123000402_r33 doi: 10.1016/j.system.2012.10.012 – ident: S0272263123000402_r47 doi: 10.1057/9780230511804 – ident: S0272263123000402_r63 doi: 10.1177/1362168818817945 – ident: S0272263123000402_r57 doi: 10.1075/sibil.47.05ch3 – ident: S0272263123000402_r56 doi: 10.1075/scl.78.05tra – ident: S0272263123000402_r12 doi: 10.1037/h0093511 – volume: 37 start-page: 828 year: 2016 ident: S0272263123000402_r54 article-title: The effects of complexity, accuracy, and fluency on communicative adequacy in oral task performance publication-title: Applied Linguistics – ident: S0272263123000402_r4 – ident: S0272263123000402_r51 doi: 10.1111/modl.12666 – volume-title: Problems and methods of linguistic statistics year: 1960 ident: S0272263123000402_r19 – volume: 12 start-page: 119 year: 2004 ident: S0272263123000402_r24 article-title: The NICT JLE Corpus: Exploiting the language learners’ speech database for research and education publication-title: International Journal of The Computer, the Internet and Management – ident: S0272263123000402_r53 doi: 10.1017/CBO9780511732942 – ident: S0272263123000402_r3 doi: 10.1111/lang.12232 – volume: 20 start-page: 55 year: 2016 ident: S0272263123000402_r31 article-title: Automated scoring of L2 spoken English with random forests publication-title: Journal of Pan-Pacific Association of Applied Linguistics – ident: S0272263123000402_r7 doi: 10.5054/tq.2011.244483 – start-page: 240 volume-title: Selected proceedings of the 31st Second Language Research Forum year: 2014 ident: S0272263123000402_r18 – ident: S0272263123000402_r42 – ident: S0272263123000402_r1 – ident: S0272263123000402_r17 doi: 10.1044/2015_JSLHR-L-14-0280 – volume: 39 start-page: 302 year: 2018 ident: S0272263123000402_r59 article-title: Back to basics: How measures of lexical diversity can help discriminate between CEFR levels publication-title: Applied Linguistics – ident: S0272263123000402_r50 doi: 10.1093/applin/amp044 – ident: S0272263123000402_r61 doi: 10.1093/applin/amv002 – ident: S0272263123000402_r25 doi: 10.1191/0265532202lt220oa – ident: S0272263123000402_r48 doi: 10.1177/0265532207080767 – ident: S0272263123000402_r10 doi: 10.1002/j.2330-8516.1985.tb00106.x – ident: S0272263123000402_r36 doi: 10.1111/modl.12468 – volume: 2 start-page: 73 year: 1971 ident: S0272263123000402_r44 article-title: Über den Zusammenhang zwischen Wortschatzumfang und Länge eines Textes [On the connection between vocabulary breadth and text length] publication-title: Zeitschrift Für Literaturwissenschaft Und Linguistik – ident: S0272263123000402_r40 doi: 10.1017/S0267190521000039 – ident: S0272263123000402_r28 doi: 10.1016/j.jslw.2003.09.001 – ident: S0272263123000402_r37 doi: 10.1080/15434303.2020.1844205 – ident: S0272263123000402_r13 doi: 10.1080/09296171003643098 – ident: S0272263123000402_r16 – ident: S0272263123000402_r20 doi: 10.1044/jshr.2901.129 – ident: S0272263123000402_r5 doi: 10.18637/jss.v067.i01 – ident: S0272263123000402_r38 doi: 10.1177/0265532215587391 – ident: S0272263123000402_r2 – ident: S0272263123000402_r9 doi: 10.1016/j.system.2020.102246 – ident: S0272263123000402_r43 doi: 10.1111/j.1540-4781.2011.01232_1.x – ident: S0272263123000402_r34 doi: 10.1075/bpa.13.10koi – ident: S0272263123000402_r60 doi: 10.1023/A:1001749303137 – ident: S0272263123000402_r23 doi: 10.1093/applin/amm017 – ident: S0272263123000402_r30 doi: 10.1111/jedm.12000 – volume-title: Statistical power analysis fo the behavioral sciences year: 1988 ident: S0272263123000402_r67 – ident: S0272263123000402_r65 doi: 10.1016/j.asw.2020.100505 – ident: S0272263123000402_r29 doi: 10.1037/h0093508 – ident: S0272263123000402_r49 doi: 10.3758/BRM.42.2.381 – ident: S0272263123000402_r14 doi: 10.1016/j.asw.2005.02.001 – ident: S0272263123000402_r39 doi: 10.1177/02655322211057868 – ident: S0272263123000402_r52 doi: 10.1093/applin/amt013 |
| SSID | ssj0006773 |
| Score | 2.4067783 |
| Snippet | Although lexical diversity is often used as a measure of productive proficiency (e.g., as an aspect of lexical complexity) in SLA studies involving oral tasks,... |
| SourceID | proquest crossref cambridge |
| SourceType | Aggregation Database Enrichment Source Index Database Publisher |
| StartPage | 278 |
| SubjectTerms | Aktionsart Correlation Essays Language Language Acquisition Methods Forum Productivity Sampling Second language learning Spoken language |
| Title | Evaluating evidence for the reliability and validity of lexical diversity indices in L2 oral task responses |
| URI | https://www.cambridge.org/core/product/identifier/S0272263123000402/type/journal_article https://www.proquest.com/docview/2985579570 |
| Volume | 46 |
| hasFullText | 1 |
| inHoldings | 1 |
| isFullTextHit | |
| isPrint | |
| link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3NT8IwFG8ULl6M36JoejAejI2jbOt2MkogxBBCiERupJ-GQAayefC_93XrQGLCqVnXtzR9r6-_9L39HkJ3Pm8KL6A-CZXixOeBIsKXMQG0Kz3lSy5kzvbZD7sj_20cjN2FW-rSKkufmDtqtZD2jvyJxlEQsDhg3vPyi9iqUTa66kpo7KMquOAILLz62u4PhmtfHLIixkwZJTRsNsq4Zk4aDZ22D6ZlTZn-ZVfYPqW2nXR-8nSO0KGDjPil0PEx2tPJCbrouYvGFN_j3pobOT1Fs7Yj8E4-sXY1QzFAUwxQD6_0fFowc_9gnigMQ6fKPiwMttSYoDGsylQNbOPZ4EegxT2K7b_8OOPpDL6SJ9bq9AyNOu33Vpe4kgpEAlDISBjFod3j0lZ2iWMjIqUbTFHDGWAPS7zDFI-o5gEzngAoYYwIjE1IMwoOMto8R5VkkehLhEFChbLJtRDG17HgSoBVAoIIlZQ-ozX0uF7OidsY6aRIKmOTf6tfQ1654hPp6MltlYz5LpGHtciy4ObYNbheqnEzm41RXe1-fY0OKKCZIvmsjirZ6lvfABrJxK0zOWhbw97g4xe9TtyP |
| linkProvider | ProQuest |
| linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwzV1LT9wwEB6h5UAvLaUPKLTMoe2haiB443hz6KGioKWkqKpA5Zb6idCiLCJBiP6V_hV-HOPEWV7S3pB6ipLYUex8nhnbX74BeJ_Ivoo5S6LUGBklkptIJTqLKNrVsUm0VLpR-9xLhwfJ90N-OAP_un9hPK2ys4mNoTZj7dfI11k24FxkXMSBQblrLy9oflZ92flGH_MDY9tb-5vDKKQQiDQ5xjpKB1nqMa19JpMsc2pg7IYwzElBvtYLzQgjB8xKLlysyHU6p7jzBCxnyHB7VQOy77M0q-BxD2Y3f-U_f08MfSraDWwmWMTS_ka3adooUtNFf43a7McJuy3dcNcF3vUAjVvbfgZXXYe0bJbR2nmt1vTfe1qR_2mPzcPTEE7j1xb_z2HGlgvwOg-LsBV-xHyiG129gNFWEDcvj9CGfKpIYTtSGIxn9uS4VS2_RFkapKLHxp-MHXrZUEIzmo7Ggn6vn2wsHTFn6HUOsJbViJ7SkI5t9RIOHqXlr6BXjku7CEg1TKr70irlEpspaRSNWIquUqN1ItgSfJ6goQhGoypawp0oHoBnCeIOMIUO0u0-g8jJtCqfJlVOW92SaYVXOgTdvM0NfN5Mv70Kc8P9H3mR7-ztLsMTRlFfS9JbgV59dm7fUtRWq3dh9CD8eWz4XQMoSkrE |
| linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMw1V1LT9VAFD4hl8S4UfAFAnoW6sI4UOa2nXZBjAFuQBpCjER2dZ6GXNKLtMTgT_Ov-Gc4004vosndsXDVdNqZtNPvPNr5-h2AV7EcqijhMUuNkSyWiWEq1jmjbFdHJtZS6Vbt8zDdO44_niQnc_Cr_xfG0yp7n9g6ajPR_hv5Bs-zJBF5IqINF2gRRzuj9-ffma8g5Vda-3IaHUQO7NUPen2rt_Z36Fm_5ny0-3l7j4UKA0xT3GxYmuWph7z2hU7y3KnM2E1huJOCQrHXoRFGZtzKRLhIUWR1TiXO87OcIb_uRQ_I_c9nNE42gPntT8XRl2kcSEW3vs0FZzwdbvZrqq1gNTX6NpoSb0b8T2WH2xHydoBoo97oIfzu56sju4zXLxu1rn_-JSX5f07oAjwIyTh-6KxnEeZs9QieFeETbo1vsJiqTtePYbwbpNGrb2hDNVakpB8picYLe3baaZ5foawM0qmnxu9MHHrRUbIFND0JBj1TgDw0bbHg6FUSsJH1mEZpKcu2fgLHd3LnT2FQTSq7BEg9TKqH0irlYpsraRTZO-VmqdE6FnwZ3k3BUgaXU5cdXU-U_2BrGaIeT6UOwu--_sjZrC5vp13OO9WTWSev9gC7uZobdD2fffgl3CPYlcX-4cEK3OeUMnYMv1UYNBeXdo1Svka9CLaF8PWu0XcNRChipg |
| openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Evaluating+evidence+for+the+reliability+and+validity+of+lexical+diversity+indices+in+L2+oral+task+responses&rft.jtitle=Studies+in+second+language+acquisition&rft.au=Kyle%2C+Kristopher&rft.au=Sung%2C+Hakyung&rft.au=Eguchi%2C+Masaki&rft.au=Zenker%2C+Fred&rft.date=2024-03-01&rft.pub=Cambridge+University+Press&rft.issn=0272-2631&rft.eissn=1470-1545&rft.volume=46&rft.issue=1&rft.spage=278&rft.epage=299&rft_id=info:doi/10.1017%2FS0272263123000402&rft.externalDBID=HAS_PDF_LINK |
| thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=0272-2631&client=summon |
| thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=0272-2631&client=summon |
| thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=0272-2631&client=summon |