Scoring probabilistic forecasts : The importance of being proper
Abstract Questions remain regarding how the skill of operational probabilistic forecasts is most usefully evaluated or compared, even though probability forecasts have been a long-standing aim in meteorological forecasting. This paper explains the importance of employing proper scores when selecting...
Saved in:
Published in | Weather and forecasting Vol. 22; no. 2; pp. 382 - 388 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
Boston, MA
American Meteorological Society
01.04.2007
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Summary: | Abstract
Questions remain regarding how the skill of operational probabilistic forecasts is most usefully evaluated or compared, even though probability forecasts have been a long-standing aim in meteorological forecasting. This paper explains the importance of employing proper scores when selecting between the various measures of forecast skill. It is demonstrated that only proper scores provide internally consistent evaluations of probability forecasts, justifying the focus on proper scores independent of any attempt to influence the behavior of a forecaster. Another property of scores (i.e., locality) is discussed. Several scores are examined in this light. There is, effectively, only one proper, local score for probability forecasts of a continuous variable. It is also noted that operational needs of weather forecasts suggest that the current concept of a score may be too narrow; a possible generalization is motivated and discussed in the context of propriety and locality. |
---|---|
Bibliography: | ObjectType-Article-1 SourceType-Scholarly Journals-1 ObjectType-Feature-2 content type line 23 |
ISSN: | 0882-8156 1520-0434 |
DOI: | 10.1175/waf966.1 |