High-Stakes Testing and Second Chances: From Data to Models
High-stakes tests are high pressure, high consequence exams that are used to inform decisions of significant impact, such as educational opportunities, job placement, and career advancement. This dissertation advances the understanding of high-stakes aptitude assessments through empirical examinatio...
Saved in:
Main Author | |
---|---|
Format | Dissertation |
Language | English |
Published |
ProQuest Dissertations & Theses
01.01.2024
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | High-stakes tests are high pressure, high consequence exams that are used to inform decisions of significant impact, such as educational opportunities, job placement, and career advancement. This dissertation advances the understanding of high-stakes aptitude assessments through empirical examination of the Aviation Selection Test Battery (ASTB), focusing on its role in selecting candidates for military aviation training. This research utilizes a rich dataset spanning 2013 to 2020, which includes detailed sociodemographic, educational, and aviation-related data used to evaluate the impact of prior experiences, including retesting, on selection test scores and aviation training performance. Findings reveal complexities in distinguishing innate aptitudes from prior educational and test-related experiences, which are also confounded with sociodemographic variables. Furthermore, retesting provides individuals with limited test-relevant experiences additional opportunities to improve selection test scores. However, large practice effects complicate the interpretation of retest scores, which also exhibit differential prediction; over-predicting training performance outcomes for retesters. These findings underscore the challenges with aptitude assessment within high-stakes settings where candidates are highly motivated to seek out test practice and those recently acquired skills are associated with test scores. This can be problematic when prior experiences, like flight instruction, may be financially prohibitive for otherwise capable individuals. Proposed interventions are discussed and include providing official test preparation to minimize disparities due to unequal access, as well as reassessing the role of certain subtests and retest scores in the selection process. This dissertation contributes to the broader discourse on high-stakes testing and has implications for military policy aimed at the pursuit of a highly capable and representative military aviation community. Through comprehensive statistical analyses and computational modeling, this dissertation provides a nuanced understanding of the ASTB's utility and limitations, suggesting pathways for enhancing equity and predictive validity in military aptitude testing. |
---|---|
AbstractList | High-stakes tests are high pressure, high consequence exams that are used to inform decisions of significant impact, such as educational opportunities, job placement, and career advancement. This dissertation advances the understanding of high-stakes aptitude assessments through empirical examination of the Aviation Selection Test Battery (ASTB), focusing on its role in selecting candidates for military aviation training. This research utilizes a rich dataset spanning 2013 to 2020, which includes detailed sociodemographic, educational, and aviation-related data used to evaluate the impact of prior experiences, including retesting, on selection test scores and aviation training performance. Findings reveal complexities in distinguishing innate aptitudes from prior educational and test-related experiences, which are also confounded with sociodemographic variables. Furthermore, retesting provides individuals with limited test-relevant experiences additional opportunities to improve selection test scores. However, large practice effects complicate the interpretation of retest scores, which also exhibit differential prediction; over-predicting training performance outcomes for retesters. These findings underscore the challenges with aptitude assessment within high-stakes settings where candidates are highly motivated to seek out test practice and those recently acquired skills are associated with test scores. This can be problematic when prior experiences, like flight instruction, may be financially prohibitive for otherwise capable individuals. Proposed interventions are discussed and include providing official test preparation to minimize disparities due to unequal access, as well as reassessing the role of certain subtests and retest scores in the selection process. This dissertation contributes to the broader discourse on high-stakes testing and has implications for military policy aimed at the pursuit of a highly capable and representative military aviation community. Through comprehensive statistical analyses and computational modeling, this dissertation provides a nuanced understanding of the ASTB's utility and limitations, suggesting pathways for enhancing equity and predictive validity in military aptitude testing. |
Author | Sibley, Ciara |
Author_xml | – sequence: 1 givenname: Ciara surname: Sibley fullname: Sibley, Ciara |
BookMark | eNqNjLsOgjAUQJuoiS_-oYkzyU3bANURJSxOsJMKV0CxVW75fxn8AKcznJOzZUvrLC5YoGOdyERGIgERr1lA1N8AQEsJSmzYKe_bLiy8eSLxEsn3tuXGNrzA2s1IO2NrpCPPRvfiZ-MN945fXYMD7dnqbgbC4McdO2SXMs3D9-g-0_yqHm4a7awqCRriSAkVyf-qL3G4OLg |
ContentType | Dissertation |
Copyright | Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works. |
Copyright_xml | – notice: Database copyright ProQuest LLC; ProQuest does not claim copyright in the individual underlying works. |
DBID | 04Z 050 054 0BH 0GS AAFGM ABUWG ADZZV AFKRA AGAJT AMEAF AQTIP AZQEC BENPR CBPLH CCPQU DWQXO EU9 G20 M8- P6D PIMPY PQCXX PQEST PQQKQ PQUKI PRINS |
DatabaseName | Dissertations & Theses Europe Full Text: Business Dissertations & Theses Europe Full Text: Health & Medicine Dissertations & Theses Europe Full Text: Social Sciences ProQuest Dissertations and Theses Professional Dissertations & Theses @ George Mason University - WRLC ProQuest Central Korea - hybrid linking ProQuest Central (Alumni) ProQuest Central (Alumni) - hybrid linking ProQuest Central ProQuest Central Essentials - hybrid linking ProQuest Dissertations & Theses Global: The Humanities and Social Sciences Collection ProQuest Women's & Gender Studies - hybrid linking ProQuest Central Essentials AUTh Library subscriptions: ProQuest Central ProQuest Dissertations & Theses Global: The Sciences and Engineering Collection ProQuest One Community College ProQuest Central Korea ProQuest Dissertations & Theses A&I ProQuest Dissertations & Theses Global ProQuest Dissertations and Theses A&I: The Sciences and Engineering Collection ProQuest Dissertations and Theses A&I: The Humanities and Social Sciences Collection Publicly Available Content Database ProQuest Central - hybrid linking ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China |
DatabaseTitle | Publicly Available Content Database Dissertations & Theses Europe Full Text: Health & Medicine ProQuest Dissertations & Theses Global: The Humanities and Social Sciences Collection Dissertations & Theses @ George Mason University - WRLC ProQuest Central Essentials ProQuest One Academic Eastern Edition ProQuest Central (Alumni Edition) ProQuest One Community College ProQuest Dissertations & Theses: Open ProQuest Dissertations & Theses Global: The Sciences and Engineering Collection ProQuest Dissertations and Theses Professional ProQuest Central China ProQuest Dissertations and Theses A&I: The Sciences and Engineering Collection ProQuest Dissertations & Theses Global ProQuest Central Dissertations & Theses Europe Full Text: Social Sciences ProQuest One Academic UKI Edition ProQuest Central Korea ProQuest Dissertations and Theses A&I: The Humanities and Social Sciences Collection Dissertations & Theses Europe Full Text: Business ProQuest One Academic ProQuest Dissertations & Theses A&I |
DatabaseTitleList | Publicly Available Content Database |
Database_xml | – sequence: 1 dbid: BENPR name: ProQuest Central url: https://www.proquest.com/central sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Genre | Dissertation/Thesis |
GroupedDBID | 04Z 050 054 0BH 0GS 8R4 8R5 ABUWG AFKRA AMEAF AZQEC BENPR CBPLH CCPQU DWQXO EU9 G20 M8- P6D PIMPY PQEST PQQKQ PQUKI PRINS Q2X |
ID | FETCH-proquest_journals_30907642463 |
IEDL.DBID | BENPR |
ISBN | 9798383628027 |
IngestDate | Thu Oct 10 21:55:16 EDT 2024 |
IsOpenAccess | true |
IsPeerReviewed | false |
IsScholarly | false |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-proquest_journals_30907642463 |
OpenAccessLink | https://www.proquest.com/docview/3090764246?pq-origsite=%requestingapplication% |
PQID | 3090764246 |
PQPubID | 18750 |
ParticipantIDs | proquest_journals_3090764246 |
PublicationCentury | 2000 |
PublicationDate | 20240101 |
PublicationDateYYYYMMDD | 2024-01-01 |
PublicationDate_xml | – month: 01 year: 2024 text: 20240101 day: 01 |
PublicationDecade | 2020 |
PublicationYear | 2024 |
Publisher | ProQuest Dissertations & Theses |
Publisher_xml | – name: ProQuest Dissertations & Theses |
SSID | ssib000933042 |
Score | 4.130309 |
Snippet | High-stakes tests are high pressure, high consequence exams that are used to inform decisions of significant impact, such as educational opportunities, job... |
SourceID | proquest |
SourceType | Aggregation Database |
SubjectTerms | Educational psychology Occupational psychology Quantitative psychology |
Title | High-Stakes Testing and Second Chances: From Data to Models |
URI | https://www.proquest.com/docview/3090764246 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1NSwMxEB10exE9KCp-VAnoNbg7SdNZPQjaLkWwiFboraTd1IO2q931_ztZUxQKPQcSEjLz5s1M8gAujTY650FpY7RSW0rY5sZGTtKpUWiVmtYqEY9903vVD8PWMCTcytBWufSJtaPOi4nPkV-pmGkcB8va3H5-Sa8a5aurQUJjExqYKKIIGnfd_tPzKl_fSdspMRszSDG2VxxvjSbZLmx3_lXB92DDzffhxndcSI793l0pBv7vi_mbYJovXjxlzYV_BsA2fS2yRTETHVtZURXCS5l9lAdwkXUH9z25XG4Urkg5-tuQOoSIub47AkFkE7KIjs1Go2Msjp1CZ1C3nCJLx9BcN9PJ-uFT2ELG5N8MQhOiavHtzhhTq_F5OLgfjsl71g |
link.rule.ids | 311,780,784,785,21388,33744,43805,74302 |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3fS8MwED60e1D0QVHROTWgr8EuSbNUHwTdStWtiFbYW8nWzAfdqmv9_73UDIXBng8SEnI_vrvLfQAXUkiRo5Bqn2kqtGqjzo0kHYcTyZnmfFKzRAwSGb-Kh2EwdAm30rVVLmxibajzYmxz5JfcRxiHwbKQN59f1LJG2eqqo9BYh4adnB540LjtJU_Py3h9O-yECtGYZMpnnSXDW3uTaAe2uv-q4LuwZmZ7cG07LijGfu-mJKmdfTF7IwjzyYuFrDmx3wBQp69INC-mpKsrTaqCWCqzj3IfzqNeehfTxXaZeyJl9ncgfgAeYn1zCEQp3VaaMYNqI5hBX-wbzoxkIjBcaXUErVUrNVeLz2AjTgf9rH-fPB7DJkP__JtNaIFXzb_NCfrXanTqLvEHejF-vg |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV3dS8MwED-0AxF9UFT8mBrQ17AsybJUHwTtyvwqQyfsrWRr6oO66lr_fy81Q2Gw54OEHLn73e_ukgM4V1LJDIXUMG6oNLqNNjdWdBLmSnAjRF5PiXhMVP9F3o06I9__VPq2yrlPrB11VkxcjrwlGNI4DJalauW-LWIQxVefX9RNkHKVVj9OYxUaiIqMB9C47iWDp0Xuvhl2Q43MTHHNeHfBCdfIEm_BRvSvIr4NK3a6A5eu-4JiHPhmSzJ0_2BMXwlSfvLs6GtG3JMAtO8LEs-KDxKZypCqIG6s2Xu5C2dxb3jTp_PtUn9dyvTvcGIPAuT9dh-I1qatDecWTUhyi7jMrOBWcdmxQht9AM1lKx0uF5_CGuovfbhN7o9gnSNU_yYWmhBUs297jFBbjU-8Dn8Au1yC6w |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Adissertation&rft.genre=dissertation&rft.title=High-Stakes+Testing+and+Second+Chances%3A+From+Data+to+Models&rft.DBID=04Z%3B050%3B054%3B0BH%3B0GS%3BAAFGM%3BABUWG%3BADZZV%3BAFKRA%3BAGAJT%3BAMEAF%3BAQTIP%3BAZQEC%3BBENPR%3BCBPLH%3BCCPQU%3BDWQXO%3BEU9%3BG20%3BM8-%3BP6D%3BPIMPY%3BPQCXX%3BPQEST%3BPQQKQ%3BPQUKI%3BPRINS&rft.PQPubID=18750&rft.au=Sibley%2C+Ciara&rft.date=2024-01-01&rft.pub=ProQuest+Dissertations+%26+Theses&rft.isbn=9798383628027&rft.externalDBID=HAS_PDF_LINK |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9798383628027/lc.gif&client=summon&freeimage=true |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9798383628027/mc.gif&client=summon&freeimage=true |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=9798383628027/sc.gif&client=summon&freeimage=true |