Multifaceted Rasch Model in Competition Assessment An Empirical Study Based on Counselors' Professional Ability Competition

• Published in: 2018 37th Chinese Control Conference (CCC) pp. 2350 - 2354
• Main Authors: Huang, Siyuan, Wang, Yuanyuan, Li, Qiuyu, Yuw, Tian
• Format: Conference Proceeding
• Language: English
• Published: Technical Committee on Control Theory, Chinese Association of Automation 01.07.2018
• Subjects: Analytical models; Data models; Grouping assessment; Item Characteristic function; Linguistics; Mathematical model; Multifaceted Rasch model; Score correction; Software; Testing
• ISSN: 2161-2927
• DOI: 10.23919/ChiCC.2018.8482967

In the event of large-scale competitions, various factors such as the criterion of judges, the characteristic level of competitors and the testing mechanism affect the assessments on the practical capacity of competitors, making an unfair result. This paper introduces a Multifaceted Rasch Model which is based on Item Characteristic function. From the aspects of judges, competitors and testing mechanism, Facets Statistics Software is used in this model to analyze the consistency and deviation of the competitors' scores, so that the three aspects can fall into the same evaluation scale. According to empirical analysis, to introduce an intermediate value as a parameter based on the model to further comprehensively correct the scores can obtain a good fitting result, which to some extent reduces the error of the assessment results brought by the subjective factors from the judges from different groups, and improves the fairness of the competition, providing a new way for the competition assessment.