Assessing the comparability of teacher-related constructs in TIMSS 2015 across 46 education systems: an alignment optimization approach

• Published in: Educational assessment, evaluation and accountability Vol. 33; no. 1; pp. 105 - 137
• Main Authors: Glassow, Leah Natasha, Rolfe, Victoria, Hansen, Kajsa Yang
• Format: Journal Article
• Language: English
• Published: Dordrecht Springer Netherlands 01.02.2021; Springer; Springer Nature B.V
• Subjects: Academic achievement; Achievement Tests; Alignment optimization; Analysis; Assessment; characteristics; Education; Education & Educational Research; Educational Environment; Educational Sciences; Elementary Secondary Education; Factor Analysis; Foreign Countries; International Assessment; Job Satisfaction; Mathematics Achievement; Mathematics Teachers; Mathematics Tests; Measurement invariance; Optimization; Outcomes of Education; School Safety; Schools; Self Efficacy; Surveys; Teacher; Teacher Characteristics; Teacher Effectiveness; Teachers; Testing and Evaluation; TIMSS; Utbildningsvetenskap; TIMSS; Alignment optimization; Measurement invariance; Teacher characteristics
• ISSN: 1874-8597; 1874-8600; 1874-8600
• DOI: 10.1007/s11092-020-09348-2

Research related to the “teacher characteristics” dimension of teacher quality has proven inconclusive and weakly related to student success, and addressing the teaching contexts may be crucial for furthering this line of inquiry. International large-scale assessments are well positioned to undertake such questions due to their systematic sampling of students, schools, and education systems. However, researchers are frequently prohibited from answering such questions due to measurement invariance related issues. This study uses the traditional multiple group confirmatory factor analysis (MGCFA) and an alignment optimization method to examine measurement invariance in several constructs from the teacher questionnaires in the Trends in International Mathematics and Science Study (TIMSS) 2015 across 46 education systems. Constructs included mathematics teacher’s Job satisfaction , School emphasis on academic success , School condition and resources , Safe and orderly school , and teacher’s Self-efficacy. The MGCFA results show that just three constructs achieve invariance at the metric level. However, an alignment optimization method is applied, and results show that all five constructs fall within the threshold of acceptable measurement non-invariance. This study therefore presents an argument that they can be validly compared across education systems, and a subsequent comparison of latent factor means compares differences across the groups. Future research may utilize the estimated factor means from the aligned models in order to further investigate the role of teacher characteristics and contexts in student outcomes.