A Critique of the Bayesian Information Criterion for Model Selection
The Bayesian information criterion (BIC) has become a popular criterion for model selection in recent years. The BIC is intended to provide a measure of the weight of evidence favoring one model over another, or Bayes factor. It has, however, some important drawbacks that are not widely recognized....
Saved in:
Published in | Sociological methods & research Vol. 27; no. 3; pp. 359 - 397 |
---|---|
Main Author | |
Format | Journal Article |
Language | English |
Published |
Beverly Hills, Calif
SAGE Publications
01.02.1999
Sage Publications SAGE PUBLICATIONS, INC |
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | The Bayesian information criterion (BIC) has become a popular criterion for model selection in recent years. The BIC is intended to provide a measure of the weight of evidence favoring one model over another, or Bayes factor. It has, however, some important drawbacks that are not widely recognized. First, Bayes factors depend on prior beliefs about the expected distribution of parameter values, and there is no guarantee that the Bayes factor implied by the BIC will be close to one calculated from a prior distribution that an observer would actually regard as appropriate. Second, to obtain the Bayes factors that follow from the BIC, investigators would have to vary their prior distributions depending on the marginal distributions of the variables and the nature of the hypothesis. Such variations seem unwarranted in principle and tend to make the BIC inclined to favor excessively simple models in practice. These points are illustrated by the analysis of several examples, and alternatives to use of the BIC are discussed. |
---|---|
Bibliography: | ObjectType-Article-2 SourceType-Scholarly Journals-1 ObjectType-Feature-1 content type line 23 ObjectType-Article-1 ObjectType-Feature-2 |
ISSN: | 0049-1241 1552-8294 |
DOI: | 10.1177/0049124199027003002 |