Web-Based Assessment of Mental Well-Being in Early Adolescence: A Reliability Study

• Published in: Journal of medical Internet research Vol. 18; no. 6; p. e138
• Main Authors: Hamann, Christoph, Schultze-Lutter, Frauke, Tarokh, Leila
• Format: Journal Article
• Language: English
• Published: Canada Gunther Eysenbach MD MPH, Associate Professor 15.06.2016; JMIR Publications
• Subjects: Adolescent; Adolescents; Anxiety; Anxiety - diagnosis; Behavior change; Child; Child development; Children & youth; Depression - diagnosis; Electronic publishing; Evaluation; Female; Humans; Internet; Male; Mental depression; Mental Health; Psychology, Adolescent - methods; Questionnaires; Reliability; Reproducibility of Results; Researchers; Short Paper; Surveys and Questionnaires; Teenagers; Well being; early adolescence; online assessment; reliability
• ISSN: 1438-8871; 1439-4456; 1438-8871
• DOI: 10.2196/jmir.5482

The ever-increasing use of the Internet among adolescents represents an emerging opportunity for researchers to gain access to larger samples, which can be queried over several years longitudinally. Among adolescents, young adolescents (ages 11 to 13 years) are of particular interest to clinicians as this is a transitional stage, during which depressive and anxiety symptoms often emerge. However, it remains unclear whether these youngest adolescents can accurately answer questions about their mental well-being using a Web-based platform. The aim of the study was to examine the accuracy of responses obtained from Web-based questionnaires by comparing Web-based with paper-and-pencil versions of depression and anxiety questionnaires. The primary outcome was the score on the depression and anxiety questionnaires under two conditions: (1) paper-and-pencil and (2) Web-based versions. Twenty-eight adolescents (aged 11-13 years, mean age 12.78 years and SD 0.78; 18 females, 64%) were randomly assigned to complete either the paper-and-pencil or the Web-based questionnaire first. Intraclass correlation coefficients (ICCs) were calculated to measure intrarater reliability. Intraclass correlation coefficients were calculated separately for depression (Children's Depression Inventory, CDI) and anxiety (Spence Children's Anxiety Scale, SCAS) questionnaires. On average, it took participants 17 minutes (SD 6) to answer 116 questions online. Intraclass correlation coefficient analysis revealed high intrarater reliability when comparing Web-based with paper-and-pencil responses for both CDI (ICC=.88; P<.001) and the SCAS (ICC=.95; P<.001). According to published criteria, both of these values are in the "almost perfect" category indicating the highest degree of reliability. The results of the study show an excellent reliability of Web-based assessment in 11- to 13-year-old children as compared with the standard paper-pencil assessment. Furthermore, we found that Web-based assessments with young adolescents are highly feasible, with all enrolled participants completing the Web-based form. As early adolescence is a time of remarkable social and behavioral changes, these findings open up new avenues for researchers from diverse fields who are interested in studying large samples of young adolescents over time.