Automatic generation of weather forecast texts using comprehensive probabilistic generation-space models

• Published in: Natural language engineering Vol. 14; no. 4; pp. 431 - 455
• Main Author: BELZ, ANJA
• Format: Journal Article
• Language: English
• Published: Cambridge, UK Cambridge University Press 01.10.2008
• Subjects: Automatic Text Generation; Computational Linguistics; Computer Modeling and Simulation; Language; Natural language; Natural Language Generation; Natural Language Processing; Statistical Analysis; Statistical methods; Subject specialists; Trends; Weather forecasting
• ISSN: 1351-3249; 1469-8110
• DOI: 10.1017/S1351324907004664

Two important recent trends in natural language generation are (i) probabilistic techniques and (ii) comprehensive approaches that move away from traditional strictly modular and sequential models. This paper reports experiments in which pcru – a generation framework that combines probabilistic generation methodology with a comprehensive model of the generation space – was used to semi-automatically create five different versions of a weather forecast generator. The generators were evaluated in terms of output quality, development time and computational efficiency against (i) human forecasters, (ii) a traditional handcrafted pipelined nlg system and (iii) a halogen-style statistical generator. The most striking result is that despite acquiring all decision-making abilities automatically, the best pcru generators produce outputs of high enough quality to be scored more highly by human judges than forecasts written by experts.