Towards Next Generation Rubrics: An Automated Assignment Feedback System

• Published in: AJIS. Australasian journal of information systems Vol. 21
• Main Authors: Nathawitharana, Nilupulee, Huang, Qing, Ong, Kok-Leong, Vitartas, Peter, Jayaratne, Madhura, Alahakoon, Damminda, Midford, Sarah, Michalewicz, Aleks, Sullivan Mort, Gillian, Ahmed, Tanvir
• Format: Journal Article
• Language: English
• Published: Wollongong Australasian Association for Information Systems 01.01.2017
• Subjects: Automation; Colleges & universities; Feedback; Learning; Mathematical analysis; Software; Software development tools; Students; Systems analysis
• ISSN: 1449-8618; 1449-8618; 1326-2238
• DOI: 10.3127/ajis.v21i0.1553

As the use of blended learning environments and digital technologies become integrated into the higher education sector, rich technologies such as analytics have shown promise in facilitating teaching and learning. One popular application of analytics is Automated Writing Evaluation (AWE) systems. Such systems can be used in a formative way; for example, by providing students with feedback on digitally submitted assignments. This paper presents work on the development of an AWE software tool for an Australian university using advanced text analytics techniques. The tool was designed to provide students with timely feedback on their initial assignment drafts, for revision and further improvement. Moreover, it could also assist academics in better understanding students’ assignment performance so as to inform future teaching activities. The paper provides details on the methodology used for development of the software, and presents the results obtained from the analysis of text-based assignments submitted in two subjects. The results are discussed, highlighting how the tool can provide practical value, followed by insights into existing challenges and possible future directions.