A-102 Performance Validity Testing in Telehealth Research: A VA Traumatic Brain Injury Model Systems Study

• Published in: Archives of clinical neuropsychology Vol. 36; no. 6; p. 1151
• Main Authors: O'Rourke, Justin, Kanser, Robert J, Silva, Marc A
• Format: Journal Article
• Language: English
• Published: 31.08.2021
• ISSN: 1873-5843; 1873-5843
• DOI: 10.1093/arclin/acab062.120

Abstract Objective Studies on Performance Validity Tests (PVTs) for tele-neuropsychology (TeleNP) are sparse. Verbal PVTs appear to better translate to TeleNP, so the primary objective of this study was to provide initial data on two well-established, verbal PVTs administered via TeleNP for research participants with traumatic brain injury (TBI). Methods This secondary analysis of the Veterans Affairs TBI Model Systems data included 53 participants enrolled in a PVT module study (3/01/2020–09/20/2020) with documented moderate-to-severe TBI per Glasgow Coma Score (M = 6.5, SD = 4.4), posttraumatic amnesia duration (M = 42.7 days, SD = 47.1), and/or time to follow commands (M = 10.5 days, SD = 16.3). Participants completed two PVTs—Reliable Digit Span (RDS) and the 21-Item Test (21-IT)—alongside telephone-based cognitive assessment 1–7 years after TBI. Descriptive analyses were performed to compare PVT performances to previously established cut scores. Chi square analyses were employed to examine 21-IT and RDS as dichotomous outcomes (pass/fail) at selected cutoffs. Results RDS ranged from 5 to 16 (M = 10.5, SD = 2.4). 21-IT ranged from 7 to 21 (M = 16.4, SD = 3.1). For RDS, 9.8% were invalid with a cutscore of ≤7 and 19.6% using a cutscore of ≤8. For the 21-IT, 7.8% were in invalid using a cutscore of ≤11, and 13.7% using a cutscore of ≤12. Conclusion(s) Using previously established cut scores, telephone-administered RDS and 21-IT resulted in relatively low rates of invalid performance among individuals with moderate-to-severe TBI. These findings provide preliminary support for the RDS and 21-IT in TeleNP.