Structuring the peer assessment process: a multilevel approach for the impact on product improvement and peer feedback quality

• Published in: Journal of computer assisted learning Vol. 31; no. 5; pp. 435 - 449
• Main Authors: Gielen, M., De Wever, B.
• Format: Journal Article
• Language: English
• Published: Oxford Blackwell Publishing Ltd 01.10.2015; Wiley-Blackwell; Wiley Subscription Services, Inc
• Subjects: CAI; Collaborative Writing; College Freshmen; Computer assisted instruction; Editing; Feedback; Feedback (Response); higher education; Intervention; peer assessment; Peer Evaluation; peer feedback quality; Peer Groups; Peers; Quality of education; Scores; Statistical Analysis; structuring; Students; Teaching Methods; Web 2.0 Technologies; Web Sites
• ISSN: 0266-4909; 1365-2729
• DOI: 10.1111/jcal.12096

In order to optimize students' peer feedback processes, this study investigates how an instructional intervention in the peer assessment process can have a beneficial effect on students' performance in a wiki environment in first‐year higher education. The main aim was to study the effect of integrating a peer feedback template with a varying structuring degree. The present study involved three conditions: a no structure, a basic structure and an elaborate structure condition. Due to a clear hierarchical structure, in which over time (level 1), 168 students (level 2) are nested within 37 groups (level 3), multilevel analysis was performed to examine the effect of time, student and group level influences on students' peer feedback quality and product scores. The results revealed that both peer feedback quality and product scores increase significantly for all conditions over time, after multiple practice occasions. In addition, after several practice occasions, significant differences were found between the conditions in both peer feedback (elaborate higher than no structure) and product scores (elaborate and basic higher than no structure). Building on this, limitations, directions for future research and practical implications are presented.