Small steps to accuracy: Incremental belief updaters are better forecasters

• Published in: Organizational behavior and human decision processes Vol. 160; pp. 19 - 35
• Main Authors: Atanasov, Pavel, Witkowski, Jens, Ungar, Lyle, Mellers, Barbara, Tetlock, Philip
• Format: Journal Article
• Language: English
• Published: Elsevier Inc 01.09.2020
• Subjects: Belief revision; Belief updating; Forecasting; Prediction; Belief updating; Forecasting; Prediction; Belief revision
• ISSN: 0749-5978; 1095-9920
• DOI: 10.1016/j.obhdp.2020.02.001

•Accurate forecasters tend to update their beliefs in small, frequent steps.•Small-increment updating is a valid signal of early accuracy.•Propensity to update rather than confirm beliefs predicts improvement over time. Laboratory research has shown that both underreaction and overreaction to new information pose threats to forecasting accuracy. This article explores how real-world forecasters who vary in skill attempt to balance these threats. We distinguish among three aspects of updating: frequency, magnitude, and confirmation propensity. Drawing on data from a four-year forecasting tournament that elicited over 400,000 probabilistic predictions on almost 500 geopolitical questions, we found that the most accurate forecasters made frequent, small updates, while low-skill forecasters were prone to confirm initial judgments or make infrequent, large revisions. High-frequency updaters scored higher on crystallized intelligence and open-mindedness, accessed more information, and improved over time. Small-increment updaters had higher fluid intelligence scores, and derived their advantage from initial forecasts. Update magnitude mediated the causal effect of training on accuracy. Frequent, small revisions provided reliable and valid signals of skill. These updating patterns can help organizations identify talent for managing uncertain prospects.