Elsevier

Journal of Hydrology

Volume 492, 7 June 2013, Pages 176-189
Journal of Hydrology

Effects of measurement uncertainties of meteorological data on estimates of site water balance components

https://doi.org/10.1016/j.jhydrol.2013.03.047Get rights and content

Highlights

  • We developed a robust approach for uncertainty assessment of input data.

  • Simulation results were evaluated on measured evapotranspiration.

  • The uncertainty of eddy-covariance measurements was tackled.

  • Empirical and process based models are similarly affected by input uncertainties.

  • Uncertainties of meteorological input and of parameters have a similar importance.

Summary

Numerical water balance models are widely used in ecological and hydro sciences. However, their application is related to specific problems and uncertainties. The reliability of model prediction depends on (i) model concept, (ii) parameters, (iii) uncertainty of input data, and (iv) uncertainty of reference data. How model concept (i) and parameters (ii) effect the model’s performance is an often treated problem. However, the effects of (iii) and (iv) are typically ignored or only barely treated in context of regionalisation and generalisation. In this study, the actual measurement uncertainties of input and reference data are the main focus. Furthermore, the evaluation of model results is analysed with regard to uncertainties of reference data. A special feature is the use of evapotranspiration (measured via the eddy covariance) instead of runoff for evaluation of simulation results. It is shown that seemingly small uncertainties of measurements can create significant uncertainties in simulation results depending on the temporal scale of investigation. As an example, the uncertainty of measurements of daily global radiation sum up to an uncertainty of 250 MJ (equivalent to 100 mm) on an annual scale, which causes an uncertainty of 40 mm in simulated grass-reverence evapotranspiration. Summarised and generalised, the measurement uncertainties of all input data create an uncertainty on average of around 5% in the simulated annual evapotranspiration and of around 10% in the simulated annual seepage. However, the effects can be significantly higher in years with extreme events and can reach up to 15%. It is demonstrated that uncertainties of individual variables are not simply superposed but interact in a complex way. Thereby, it has become apparent that the effects of measurement uncertainties on model results are similar for complex and for simple models.

Introduction

The quantification of the water balance and its individual components is a necessary precondition for successful and sustainable water resources management, farming and forestry (Wisser et al., 2010, Xu and Singh, 2004, Peel and Blöschl, 2011). Typically, the water balance or individual components of water balance are estimated using numerical models (Xiong and Guo, 1999, Boughton, 2005, Schwärzel et al., 2009a). The models are very different in terms of concept, structure and complexity as various reviews have shown (e.g., Dooge, 1986, Beven, 1989, Xu and Singh, 1998, Xiong and Guo, 1999, Xu and Singh, 2004, Boughton, 2005, Liu and Gupta, 2007). Very complex models address all relevant processes (e.g., interception, transpiration, snowmelt and soil water movement) by physically based approaches. But there are also much simpler models which are driven by conceptual approaches or empirically derived relations.

All models are abstractions, simplifications and interpretations of reality (Refsgaard et al., 2006). Therefore derivations are inevitable between observations and simulations (Gupta et al., 2006, Wagener and Gupta, 2005, Kuczera et al., 2010). Following Renard et al., 2010, Butts et al., 2004 and Oudin et al. (2006), four sources for discrepancies and hence for inherent uncertainties of simulated water balance components can be identified.

Depending on scientific question and spatial and temporal scale of study, specific simplifications of model structure are absolutely essential. However, the algorithms and internal structures must be able to describe all relevant processes (and so the system) sufficiently (Wagener et al., 2001, Beven, 2006, Refsgaard et al., 2006, Kavetski et al., 2011). Thus a model never reflects or accounts all hydrological processes (Butts et al., 2004, Kuczera et al., 2010, Andréassian et al., 2010). This uncertainty is called model uncertainty.

Parameters are necessary numerical information to adapt a model to a specific application (Yang, 2011). The ‘parameter uncertainty’ reflects our limitation to specify exact values for these parameters (Renard et al., 2010). The main reasons are due to temporal dynamics of parameter values and limitations of parameter estimation (Yang et al., 2007, Reusser et al., 2011). The last point is correlated with the fact that a lot of parameters can’t be measured objectively and must be determined inversely by calibration (Gupta et al., 2006, Kavetski et al., 2006, Pappenberger et al., 2006, Wagener and Wheater, 2006). But even measurable parameters are not certain as their accuracy and representativeness is limited due to scale dependence and measurement uncertainties (Bergström and Graham, 1998, Blöschl, 2001, Beven, 2006). It is necessary to know how much information is needed to get reliable simulation results (Wagener et al., 2001, Sieber and Uhlenbrook, 2005). This question includes also which information is important and which is dispensable. Thus the analysis of parameter uncertainty is closely connected with analysis of parameter sensitivity (Reusser et al., 2011, Nossent et al., 2011).

Every measurement is related to specific tolerances. So any measured value deviates somewhat from the actual value (Taylor, 1997). The questions arise, how do uncertainties of meteorological input data (model drivers), e.g. precipitation P, affect the simulation results and do the individual uncertainties amplify or compensate each other? The term ‘input uncertainty’ includes both ‘actual measurement uncertainties’ (sampling errors) as well as uncertainties regarding to regionalisation and generalisation of measured values to derive at area or catchment estimates (Renard et al., 2010).

This point is directly related to the former point. If input data are uncertain, the data being used for verification of simulation results - the reference data as observed streamflow or (as in this study) measured evapotranspiration - include similar uncertainties. Here it is important to know how uncertainties of these data influence the evaluation of simulation results. Reference uncertainties are caused (similar to input uncertainties) by (a) limitations of measurability and (b) limitations of representativeness. A classical example for (b) is the representativeness of measured streamflow in catchments where the groundwater flow is significant share of total runoff.

Andréassian et al., 2001, Stisen et al., 2011 and Yang (2011) emphasise effects of moderate input uncertainties are often compensated by model calibration. The same can be assumed for reference uncertainties. In that way, uncertainties due to (iii) and (iv) do not only affect the prediction accuracy but also the parameter identification (Andréassian et al., 2001, Refsgaard et al., 2006, Vrugt et al., 2008, Kuczera et al., 2010, Looper et al., 2012). This should be considered if models and parameters are to be improved (Kavetski et al., 2006, Oudin et al., 2006, Stisen et al., 2011). All methods of parameter optimisation or all structural improvements of model concept are non-effective if the background noise due to input and reference uncertainties are unknown. This point is particular important for the practical application of models. So ignoring background noise due to measurement uncertainties can lead to serious misinterpretations and bad resource management if the simulation results form the basis of decision making processes (Saisana et al., 2005, Kavetski et al., 2006).

Uncertainty analysis and uncertainty assessment are important issues in hydrological research (Wagener and Gupta, 2005). Details of model uncertainties can be found in Butts et al. (2004), Refsgaard et al. (2006), Clark et al., 2008, Renard et al., 2010. Problems of parameter uncertainties are discussed in Duan et al., 1992, Bárdossy, 2007, Bárdossy and Singh, 2008, Nossent et al., 2011, Krauße and Cullmann, 2012. Effects of input uncertainties on modelling results have been studied since the late sixties (Andréassian et al., 2001). In particular, effects of sampling errors in precipitation data (e.g., Wood et al., 2000, Adam and Lettenmaier, 2003, Molini et al., 2005, Stisen et al., 2012) and shortcomings in context of up-scaling and interpolation of precipitation point measurements to areal (catchment) precipitation data (e.g., Moulin et al., 2009, Shao et al., 2012, Renard et al., 2011, Looper et al., 2012) are analysed.

Comprehensive studies about the complex interactions between input and reference uncertainties as well as about their effects on parameter identification and model structure optimisation have been published recently; see Renard et al., 2007, Bárdossy and Das, 2008, Vrugt et al., 2008, Salamon and Feyen, 2009, Thyer et al., 2009, Renard et al., 2010, Kavetski et al., 2011, McMillan et al., 2011 and references therein. Predominately, the focus was on catchment scale. Thus the majority of these studies deal with shortcomings of conceptual modelling and uncertainties of areal precipitation data. However, sampling errors, uncertainties in other input variables (e.g., global radiation RG, temperature T, vapour pressure e, wind speed u) as well as uncertainties of the reference were seldom tackled. These uncertainties can also have significant influence on model performance as demonstrated by Andréassian et al., 2004, Oudin et al., 2006 and McMillan et al. (2010).

As already noted, effects of moderate input uncertainties and reference uncertainties are damped or compensated by model calibration. Therefore, their impact on the reliability of model results is blurred on catchment scale. This study analyse effects of input and reference uncertainties on site scale. In contrast to previous studies, the measured evapotranspiration is used as reference instead streamflow. Furthermore, the uncertainty assessment is related to the typical range of effects rather than on potential effects (worst cases).

On site scale, input data and model parameters are hardly affected by regionalisation and generalisation; necessary simplifications of model concept and model structure are also reduced; but ‘actual measurement errors’ emerge (Blöschl and Sivapalan, 1995, Bergström and Graham, 1998, Sivapalan, 2006). Thus, the site scale is optimal to analyse direct effects of measurement uncertainties in meteorological variables but also in physical site parameters. The knowledge about effects of measurement uncertainties on simulated site water budget is very important as exact quantifications of water balance components and correct process understanding on site scale are fundamental for system understanding and system description on catchment scale (Bergström and Graham, 1998, Vázquez et al., 2002, Blöschl, 2006, Sposito, 2008, Martina et al., 2011).

Section snippets

Methodology

The four key questions, (i) model uncertainty, (ii) parameter uncertainty, (iii) input uncertainty and (iv) reference uncertainty, are analysed utilising three test sites in the low mountain range of the Erzgebirge (Ore Mountains). The focus is thereby the estimation of annual evapotranspiration ETa and annual seepage Ra. Our investigations are based on very small spatial scale (identical to the term ‘site scale’). Thus, all effects due to regionalisation and generalisation of input variables

Periods of investigation

The periods of investigation were determined by the availability of EC data and by the timing of the study. Complete yearly data series were used from 1997–2008 (Spruce site), 2004–2009 (Grassland site) and 2005–2009 (Agricultural site). Each period starts on April 1st and ends on March 31st of the following year. As a representative for all sites, Fig. 2 illustrates the yearly totals of precipitation Pa, the totals of precipitation in summer months Ps (April until October), the yearly total of

Summary and conclusions

The aim of the study was to analyse and evaluate how uncertainties in measured input and reference data affect the reliability of predicted site water budget. The focus was on annual evapotranspiration ETa and annual seepage Ra. The sensitivity to measurement uncertainties was analysed for two models of different complexity (HPTFs as a simple model, BROOK90 as a complex model) at three well instrumented experimental sites in the lower Erzgebirge (Ore Mountains, Germany). In this context,

Acknowledgements

This study was supported by the German Science Foundation (DFG) in the framework of the project “Model Based Classification of the Water Balance of Forest Sides in Low-range Mountain Areas” (FE 504/2-2) and “External factors of eco-technological water management – influences of land use and climate change” (BE 1721/13-1). The measurements at the test sites were supported by a series of EU projects including EUROFLUX (ENVCT 0095-0078), CARBOEUROFLUX (ENVK2-1999-00229) and CARBOEUROPE-IP

References (112)

  • H. McMillan et al.

    Rainfall uncertainty in hydrological modelling: an evaluation of multiplicative error models

    J. Hydrol.

    (2011)
  • S.J. Meyer et al.

    Estimating potential evapotranspiration: the effect of random and systematic errors

    Agric. For. Meteorol.

    (1989)
  • J. Nossent et al.

    Sobol’ sensitivity analysis of a complex environmental model

    Environ. Modell. Softw.

    (2011)
  • L. Oudin et al.

    Which potential evapotranspiration input for a lumped rainfall-runoff model? Part 2 – towards a simple and efficient potential evapotranspiration model for rainfall-runoff modelling

    J. Hydrol.

    (2005)
  • L. Oudin et al.

    Impact of biased and randomly corrupted inputs on the efficiency and the parameters of watershed models

    J. Hydrol.

    (2006)
  • F. Pappenberger et al.

    Sensitivity analysis based on regional splits and regression trees (SARS-RT)

    Environ. Modell. Softw.

    (2006)
  • A.K. Prescher et al.

    Land use regulates carbon budgets in eastern Germany: from NEE to NBP

    Agric. For. Meteorol.

    (2010)
  • J.C. Refsgaard et al.

    A framework for dealing with uncertainty due to model structure error

    Adv. Water Resour.

    (2006)
  • P. Salamon et al.

    Assessing parameter, precipitation, and predictive uncertainty in a distributed hydrological model using sequential data assimilation with the particle filter

    J. Hydrol.

    (2009)
  • K. Schwärzel et al.

    A novel approach in model-based mapping of soil water conditions at forest sites

    For. Ecol. Manage.

    (2009)
  • K. Schwärzel et al.

    Soil water content measurements deliver reliable estimates of water fluxes: a comparative study in a beech and a spruce stand in the Tharandt forest (Saxony, Germany)

    Agric. For. Meteorol.

    (2009)
  • Q. Shao et al.

    Gauge based precipitation estimation and associated uncertainties

    J. Hydrol.

    (2012)
  • A. Sieber et al.

    Sensitivity analyses of a distributed catchment model to verify the model structure

    J. Hydrol.

    (2005)
  • I.M. Sobol

    Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates

    Math. Comp. Simul.

    (2001)
  • T.E. Twine et al.

    Correcting eddy-covariance flux underestimates over a grassland

    Agric. For. Meteorol.

    (2000)
  • T. Wagener et al.

    Parameter estimation and regionalization for continuous rainfall-runoff models including uncertainty

    J. Hydrol.

    (2006)
  • J.C. Adam et al.

    Adjustment of global gridded precipitation for systematic bias

    J. Geophys. Res.

    (2003)
  • Ad-hoc-AG Boden, 2005. Bodenkundliche Kartieranleitung, 5. Aufl., Schweizerbart’sche Verlagsbuchhandlung,...
  • Allen, R.G., Pereira, L.S., Raes, D., Smith, M., 2006. Crop Evaporation (guidelines for computing crop water...
  • V. Andréassian et al.

    The Court of Miracles of Hydrology: can failure stories contribute to hydrological science?

    Hydrol. Sci. J.

    (2010)
  • M. Aubinet et al.

    Estimates of the annual net carbon and water exchange of forests: the EUROFLUX methodology

    Adv. Ecol. Res.

    (2000)
  • M. Aubinet et al.

    Eddy Covariance: A Practical Guide to Measurement and Data Analysis

    (2012)
  • A. Bárdossy

    Calibration of hydrological model parameters for ungauged catchments

    Hydrol. Earth Syst. Sci.

    (2007)
  • A. Bárdossy et al.

    Influence of rainfall observation network on model calibration and application

    Hydrol. Earth Syst. Sci.

    (2008)
  • A. Bárdossy et al.

    Robust estimation of hydrological model parameters

    Hydrol. Earth Syst. Sci.

    (2008)
  • K. Beven et al.

    The future of distributed models: model calibration and uncertainty prediction

    Hydrol. Process.

    (1992)
  • K. Binder et al.

    Monte Carlo Simulation in Statistical Physics: An Introduction

    (2010)
  • G. Blöschl

    Scaling in hydrology

    Hydrol. Process.

    (2001)
  • G. Blöschl

    Hydrologic synthesis: across processes, places, and scales

    Water Resour. Res.

    (2006)
  • G. Blöschl et al.

    Scale issues in hydrological modelling: a review

    Hydrol. Process.

    (1995)
  • Bundesanstalt für Gewässerkunde, 2003. Hydrologischer Atlas von Deutschland. <http://maps.wasserblick.net:8080/>...
  • G.G. Burba et al.

    A Brief Practical Guide to Eddy Covariance Flux Measurements: Principles and Workflow Examples for Scientific and Industrial Applications

    (2010)
  • CarboEurope-IP, 2008a. Integrated Project CarboEurope-IP, Assessment of the European Terrestrial Carbon Balance....
  • CarboEurope-IP, 2008b. Ecosystem Component Database. <http://gaia.agraria.unitus.it/database/carboeuropeip/> (accessed...
  • M.P. Clark et al.

    Framework for Understanding Structural Errors (FUSE): a modular framework to diagnose differences between hydrological models

    Water Resour. Res.

    (2008)
  • Clausnitzer, F., 2009. Measurement and Estimation of Canopy Parameters from a Spruce and Beech Stand in Tharandt...
  • J.C.I. Dooge

    Looking for hydrologic laws

    Water Resour. Res.

    (1986)
  • Q. Duan et al.

    Effective and efficient global optimization for conceptual rainfall-runoff models

    Water Resour. Res.

    (1992)
  • Federer, C.A., 2002. BROOK 90: A Simulation Model for Evaporation, Soil Water, and Streamflow....
  • FLUXNET, 2007. Integration Worldwide CO2 Flux Measurements. <http://www.fluxnet.ornl.gov/fluxnet/index.cfm> (accessed...
  • Cited by (21)

    • Assessment of total evaporation rates and its surface distribution by tridimensional modelling and remote sensing

      2023, Journal of Environmental Management
      Citation Excerpt :

      Solar radiation data was increased by 15% in order to correctly calibrate the water budget. The previous consideration was accepted knowing the uncertainties related to the measurements (Lan et al., 2021; Spank et al., 2013; Zhang et al., 2022), aside from those being performed in a nearby but not in-situ meteorological station. Data gaps were less than 1% for all the variables and they were filled with mean values of each forcing.

    • A framework to use crop models for multi-objective constrained optimization of irrigation strategies

      2016, Environmental Modelling and Software
      Citation Excerpt :

      Crop models aim to predict agricultural yields from selected soil properties, plant characteristics and climatic forcings, and possibly dependent on irrigation strategies. Even if they are of limited extent, the random uncertainties in source data (Nonhebel, 1994; Aggarwal, 1995; Heinemann et al., 2002; Rivington et al., 2006; Spank et al., 2013) can combine and propagate through the models, whose predictions should therefore include statistical confidence intervals or at least relevant, dedicated estimates of the error terms or trends affecting model outputs (Monteith, 1996; Challinor et al., 2009, 2010; Wallach et al., 2012; Asseng et al., 2013). Noticeable differences exist between model structures, purposes and responses, especially for climate change scenarios, hence the difficulty to decipher absolute, normative evaluations.

    • Effects of uncertainties in hydrological modelling. A case study of a mountainous catchment in Southern Norway

      2016, Journal of Hydrology
      Citation Excerpt :

      Important systematic errors originate from the under-catch in precipitation gauges and from unknown spatial trends that are approximated in the interpolation. The effect of uncertainty in inputs on streamflow predictions is often addressed using a Monte Carlo approach where an ensemble of inputs is shuffled through a hydrological model to get an ensemble of outputs (e.g. Spank et al., 2013; Yoo et al., 2012). Alternatively, an inverse approach might be used by applying a multiplier to each rainfall event (Kavetski et al., 2006a,b; Reichert and Mieleitner, 2009; Sun and Bertrand-Krajewski, 2013; Vrugt et al., 2008).

    • Usability of calcium carbide gas pressure method in hydrological sciences

      2013, Journal of Hydrology
      Citation Excerpt :

      Adequate number of parameters must be known and used in the model for more accurate results. However, complex models that address higher number of relevant processes such as interception, transpiration, snowmelt and soil water movement bring uncertainties from different sources (Spank et al., 2013) and it is a challenging work to quantify the contributions of these sources to the total amount of the error. Both the remote sensing and the water balance simulation methods can be used for larger areas with respect to the ground based methods.

    View all citing articles on Scopus
    1

    Current address.

    View full text