Statistical models for evaluating suspected artefacts in long-term environmental monitoring data

• Published in: Environmental monitoring and assessment Vol. 190; no. 9; pp. 558 - 17
• Main Authors: von Brömssen, Claudia, Fölster, Jens, Futter, Martyn, McEwan, Kerstin
• Format: Journal Article
• Language: English
• Published: Cham Springer International Publishing 01.09.2018; Springer Nature B.V
• Subjects: Additives; Ammonium nitrogen; Analysis; Artefacts; Atmospheric Protection/Air Quality Control/Air Pollution; Data; Earth and Environmental Science; Ecology; Ecotoxicology; Environment; Environmental Management; Environmental monitoring; Environmental science; Environmental Sciences; Estimates; Laboratories; Mathematical analysis; Mathematical models; Miljövetenskap; Monitoring/Environmental Analysis; Seasonal variation; Seasonal variations; Statistical analysis; Statistical methods; Statistical models; Time series; Trend analysis; Trends; Water monitoring; Water quality; Water quality management; Water quality monitoring; Weather; Weather conditions; Trend; Method change; Level shift; Generalised additive mixed models
• ISSN: 0167-6369; 1573-2959; 1573-2959
• DOI: 10.1007/s10661-018-6900-3

Long-term water quality monitoring is of high value for environmental management as well as for research. Artificial level shifts in time series due to method improvements, flaws in laboratory practices or changes in laboratory are a common limitation for analysis, which, however, are often ignored. Statistical estimation of such artefacts is complicated by the simultaneous existence of trends, seasonal variation and effects of other influencing factors, such as weather conditions. Here, we investigate the performance of generalised additive mixed models (GAMM) to simultaneously identify one or more artefacts associated with artificial level shifts, longitudinal effects related to temporal trends and seasonal variation, as well as to model the serial correlation structure of the data. In the same model, it is possible to estimate separate residual variances for different periods so as to identify if artefacts not only influence the mean level but also the dispersion of a series. Even with an appropriate statistical methodology, it is difficult to quantify artificial level shifts and make appropriate adjustments to the time series. The underlying temporal structure of the series is especially important. As long as there is no prominent underlying trend in the series, the shift estimates are rather stable and show less variation. If an artificial shift occurs during a slower downward or upward tendency, it is difficult to separate these two effects and shift estimates can be both biased and have large variation. In the case of a change in method or laboratory, we show that conducting the analyses with both methods in parallel strongly improves estimates of artefact effects on the time series, even if certain problems remain. Due to the difficulties of estimating artificial level shifts, posterior adjustment is problematic and can lead to time series that no longer can be used for trend analysis or other analysis based on the longitudinal structure of the series. Before carrying out a change in analytic method or laboratory, it should be considered if this is absolutely necessary. If changes cannot be avoided, the analysis of the two methods considered, or the two laboratories contracted, should be run in parallel for a considerable period of time so as to enable a good assessment of changes introduced to the data series.