Characterization of Assessments on a First Programming Course in Higher Education

• Published in: 2022 41st International Conference of the Chilean Computer Science Society (SCCC) pp. 1 - 8
• Main Authors: Sanchez, Victor Araya, Bravo, Felipe Fuentes, Loyola, Javier Salazar, Fuenzalida, Patricia Melo, Blamey, Belen Rickmers
• Format: Conference Proceeding
• Language: English
• Published: IEEE 21.11.2022
• Subjects: assessment characterization; Buildings; Education; evaluation for improvement; higher education; initial programming course; Media; Optimized production technology; Programming profession; Python; Surges
• ISSN: 2691-0632
• DOI: 10.1109/SCCC57464.2022.10000367

The present research introduces a characterization of the questions in summative assessments (tests) for an introductory programming course in higher education, developed for first-year engineering students. This characterization is a first approach that examines the disparity between the thematic contents declared in the course syllabus and those effectively present in the assessments. It also explores the difficulty level and context in which each question is presented. Additionally, a detailed review of the course's process for test building was performed, and its results allow one to conclude that the amount of time dedicated to the test building itself might be too scarce. Some of the results of this research expose that 36.8% of the declared contents in the course syllabus have been explicitly evaluated in tests, using mainly simulated situations as context for the questions (52.9%). The possibility that there might be a link between the difficulty of a question, its contents, and the given context also emerges; nonetheless, more research is required to properly assess this claim. The timeframe considered in this research includes from the second half of 2015 until the second half of 2019, in pre-pandemic conditions.