A naïve approach for deriving scoring systems to support clinical decision making

• Published in: Journal of evaluation in clinical practice Vol. 20; no. 1; pp. 1 - 6
• Main Authors: Barbini, Paolo, Cevenini, Gabriele, Furini, Simone, Barbini, Emanuela
• Format: Journal Article
• Language: English
• Published: England Blackwell Publishing Ltd 01.02.2014
• Subjects: Age Factors; Bayes Theorem; Blood Transfusion; cardiac surgery; Cardiac Surgical Procedures - methods; Decision Support Systems, Clinical - organization & administration; decision-support systems; Female; Humans; intensive care unit; Intensive Care Units; Italy; Logistic Models; Male; Models, Statistical; naïve Bayes classifiers; Predictive Value of Tests; Reproducibility of Results; ROC Curve; scoring systems; Sex Factors; transfusion planning; Italy; cardiac surgery; naïve Bayes classifiers; intensive care unit; decision-support systems; transfusion planning; scoring systems
• ISSN: 1356-1294; 1365-2753
• DOI: 10.1111/jep.12064

Rationale, aims and objectives Scoring systems are frequently proposed in medicine to summarize a set of qualitative and quantitative items by means of a numeric score. Their design often requires modelling ability and subjective judgments. This can make it difficult to adapt a scoring system to a clinical setting different from that in which the system was developed. The objective of this study was to discuss an approach to derive scoring systems, which can be easily modified and matched to any scenario. Methods A naïve Bayes approach was used to develop a scoring system that is completely defined by descriptive tables obtained by frequency counts from the training set. The approach was implemented to build a locally customized scoring system for planning transfusion requirements after cardiac surgery. The performance of this system was evaluated and compared with that of a logistic regression model designed using the same predictors. The working sample was a set of 3182 consecutive patients undergoing cardiac surgery at the University Hospital of Siena, Italy. Results The area under the receiver operating characteristic curve was equal to 0.811 and 0.824 for the scoring system and for the logistic regression model, respectively. This result proves that this global index of discrimination capacity was virtually identical and very good for both models. The values of sensitivity, specificity and overall correct‐classification percentage obtained by the leave‐one‐out method were practically the same for the two models (73.9% versus 75.3%). Conclusions An easy‐fitting and trustworthy scoring system can be directly developed using a naïve Bayes approach. The simplicity of its design allows the system to be customized to any specific institution and updated regularly. This aspect has important practical implications because it can encourage the use of scoring systems among clinicians, enabling their performance to be properly assessed in a wider clinical context.