Assessment of AI ethical reflection: the development and validation of the AI ethical reflection scale (AIERS) for university students

• Published in: International Journal of Educational Technology in Higher Education Vol. 22; no. 1; pp. 19 - 16
• Main Authors: Wang, Ziying, Chai, Ching-Sing, Li, Jiajing, Lee, Vivian Wing Yan
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.12.2025; Springer Nature B.V; SpringerOpen
• Subjects: AI ethics; Artificial Intelligence; College Students; Colleges & universities; Computer Appl. in Social and Behavioral Sciences; Computer Science; Computers and Education; Construct Validity; Digital literacy; Educational Technology; Ethical reflection; Ethics; Factor analysis; Higher Education; Humanities; Information Systems Applications (incl.Internet); Intellectual Disciplines; Law; Reflection; Research Article; Statistics for Social Sciences; STEM education; Students; Three dimensional analysis; University students; Validity; Ethical reflection; University students; AI ethics
• DOI: 10.1186/s41239-025-00519-z
• ISSN: 2365-9440

This study developed and validated the AI Ethical Reflection Scale (AIERS), a tool for measuring university students’ ethical reflection on AI in three dimensions: AI ethical awareness, AI critical evaluation, and AI for social good. This study used a sample of 730 university students, and confirmatory factor analysis supported the three-dimensional structure of the AIERS, which demonstrated good internal consistency and construct validity. Additionally, we found evidence of convergent and discriminant validity, as AI ethical reflection was positively yet modestly correlated with AI literacy, indicating that AI ethical reflection is a related yet distinct construct from AI literacy. The study also explored the differences in AI ethical reflection based on gender, academic discipline, and prior AI experience. The results revealed that female students exhibited higher AI ethical awareness than male students. Furthermore, frequent AI users reported significantly greater AI ethical reflection across all dimensions than those who used AI less frequently or had never used it. However, no significant differences were found between Science, Technology, Engineering, Mathematics (STEM) and non-STEM students. Collectively, these findings emphasize the importance of integrating ethical considerations and hands-on AI experiences from diverse perspectives of gender in AI education across disciplines to promote the ethical and responsible use of AI among university students.