The Bradley–Terry Regression Trunk approach for Modeling Preference Data with Small Trees

• Published in: Psychometrika Vol. 88; no. 4; pp. 1443 - 1465
• Main Authors: Baldassarre, Alessio, Dusseldorp, Elise, D’Ambrosio, Antonio, Rooij, Mark de, Conversano, Claudio
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.12.2023; Springer Nature B.V
• Subjects: Assessment; Behavioral Science and Psychology; Computer Simulation; Humanities; Humans; Law; Linear Models; Preferences; Psychology; Psychometrics; Simulation; Statistical Theory and Methods; Statistics for Social Sciences; Testing and Evaluation; Theory and Methods; regression tree; GLM; STIMA; paired comparisons; preference rankings
• ISSN: 0033-3123; 1860-0980; 1860-0980
• DOI: 10.1007/s11336-022-09882-6

This paper introduces the Bradley–Terry regression trunk model, a novel probabilistic approach for the analysis of preference data expressed through paired comparison rankings. In some cases, it may be reasonable to assume that the preferences expressed by individuals depend on their characteristics. Within the framework of tree-based partitioning, we specify a tree-based model estimating the joint effects of subject-specific covariates over and above their main effects. We, therefore, combine a tree-based model and the log-linear Bradley-Terry model using the outcome of the comparisons as response variable. The proposed model provides a solution to discover interaction effects when no a-priori hypotheses are available. It produces a small tree, called trunk, that represents a fair compromise between a simple interpretation of the interaction effects and an easy to read partition of judges based on their characteristics and the preferences they have expressed. We present an application on a real dataset following two different approaches, and a simulation study to test the model’s performance. Simulations showed that the quality of the model performance increases when the number of rankings and objects increases. In addition, the performance is considerably amplified when the judges’ characteristics have a high impact on their choices.