The Importance of Being Earnest: Validation is the Absolute Essential for Successful Application and Interpretation of QSPR Models

• Published in: QSAR & combinatorial science Vol. 22; no. 1; pp. 69 - 77
• Main Authors: Tropsha, Alexander, Gramatica, Paola, Gombar, Vijay K.
• Format: Journal Article
• Language: English
• Published: Weinheim WILEY-VCH Verlag 01.04.2003; WILEY‐VCH Verlag
• Subjects: applicability domain; model validation; QSAR; Structure-property relationship modeling
• ISSN: 1611-020X; 1611-0218
• DOI: 10.1002/qsar.200390007

This paper emphasizes the importance of rigorous validation as a crucial, integral component of Quantitative Structure Property Relationship (QSPR) model development. We consider some examples of published QSPR models, which in spite of their high fitted accuracy for the training sets and apparent mechanistic appeal, fail rigorous validation tests, and, thus, may lack practical utility as reliable screening tools. We present a set of simple guidelines for developing validated and predictive QSPR models. To this end, we discuss several validation strategies including (1) randomization of the modelled property, also called Y‐scrambling, (2) multiple leave‐many‐out cross‐validations, and (3) external validation using rational division of a dataset into training and test sets. We also highlight the need to establish the domain of model applicability in the chemical space to flag molecules for which predictions may be unreliable, and discuss some algorithms that can be used for this purpose. We advocate the broad use of these guidelines in the development of predictive QSPR models.