Big data and hydroinformatics

• Published in: Journal of hydroinformatics Vol. 18; no. 4; pp. 599 - 614
• Main Authors: Chen, Yiheng, Han, Dawei
• Format: Journal Article
• Language: English
• Published: London IWA Publishing 01.07.2016
• Subjects: Academic publications; Behavior; Big Data; Bioinformatics; Climate; Climatology; Commerce; Computer science; Data analysis; Data management; Data processing; Data storage; Datasets; Disease control; Drought; Flood management; Hydrologic cycle; Hydrologic data; Hydrology; Influenza; Information sharing; Internet; Knowledge management; Object oriented programming; Open data; Parallel processing; Precipitation; Public health; Rain; Rain gauges; Remote sensing; Search strategies; Sensors; Sociology; Trends; Weather
• ISSN: 1464-7141; 1465-1734
• DOI: 10.2166/hydro.2016.180

Big data is popular in the areas of computer science, commerce and bioinformatics, but is in an early stage in hydroinformatics. Big data is originated from the extremely large datasets that cannot be processed in tolerable elapsed time with the traditional data processing methods. Using the analogy from the object-oriented programming, big data should be considered as objects encompassing the data, its characteristics and the processing methods. Hydroinformatics can benefit from the big data technology with newly emerged data, techniques and analytical tools to handle large datasets, from which creative ideas and new values could be mined. This paper provides a timely review on big data with its relevance to hydroinformatics. A further exploration on precipitation big data is discussed because estimation of precipitation is an important part of hydrology for managing floods and droughts, and understanding the global water cycle. It is promising that fusion of precipitation data from remote sensing, weather radar, rain gauge and numerical weather modelling could be achieved by parallel computing and distributed data storage, which will trigger a leap in precipitation estimation as the available data from multiple sources could be fused to generate a better product than those from single sources.