Using laboratory examination to assess computer programming competences: Questionnaire-based evaluation of the impact on students

• Published in: 2018 IEEE Global Engineering Education Conference (EDUCON) pp. 355 - 363
• Main Authors: Hammer, Sabine, Hobelsberger, Martin, Braun, Georg
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01.04.2018
• Subjects: Computer Programming Competences; Education; Introductory Computer Science Course; Laboratory Examination; Mathematics; Programming profession; Questionnaire-based survey assessing the impact of lab exams; Summative Assessment; Task analysis
• ISSN: 2165-9567
• DOI: 10.1109/EDUCON.2018.8363251

The main goal of an introductory programming course for computer scientists is to develop programming competences. The question arises how to assess those competences. As there are concerns, if written and oral examinations are valid exam environments for students to demonstrate their programming skills, there is a need for an alternative exam type. Computer based laboratory examination (lab exams) promises to be a valid, reliable, efficient and competence-oriented assessment method. Therefore, the assumption is that it provides an important contribution to presently existing set of assessment methods. In this paper, we present the motivation and goals for the use of lab exams and provide background information on the course and environment we applied it on. Furthermore, results of a questionnaire-based study are demonstrated, where it is analysed how students experience this new exam type, as for example if they value the benefit of validity, accuracy and fairness and how they evaluate the lab exam as a possibility to measure action-related competences. In addition, identified factors related to the students' possibility to show their programming competences in the lab exam are presented. Finally, the conclusion explains that computer based laboratory examination is a meaningful way to assess relevant computer programming competences.