Skip to main content
SpringerLink
Log in

Sensitivity of the SIMulation-EXtrapolation (SIMEX) methodology to mis-specification of the statistical properties of the measurement errors

  • Research
  • Published:
Theoretical and Applied Climatology Aims and scope Submit manuscript

Abstract

In hydrometeorological and environmental studies, it is common to seek relations between two variables (predictand and predictor), one of which (predictor) is affected by uncertainties. These errors unavoidably affect the results of the analyses by providing erroneous estimates of the parameters of the predictor-predictand model. A possible solution is represented by the SIMulation-EXtrapolation (SIMEX) methodology. This approach follows two steps: (1) perturbation of the predictor with increasing levels of uncertainties (multiples of the known error variance); and (2) finding a relation between the model’s parameters and level of uncertainty, which allows their extrapolation to the error-free case. The application of the SIMEX methodology requires a priori knowledge of the mean, variance, and distribution of the measurement errors. However, in hydrologic and climatologic studies, this is not the case, and the impact of an erroneous specification of these statistical properties on the results of the analyses has received little attention. The aim of this study is to investigate the sensitivity of the SIMEX methodology to mis-specification of the error characteristics. By using a simulation-based approach, we investigate the impact of imperfect knowledge of the characteristics of the errors associated with the predictor (mean, variance, and probability distribution). Our results suggest that SIMEX is robust against mis-specification of the moments and distribution of the measurement errors, that it performs better than standard linear regression, even when these statistical properties are erroneously specified, and that, for these reasons, it could find a useful application to seasonal forecasting of hydroclimatic variables.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

Not applicable.

Code availability

The codes are available on Github (https://github.com/dtreppiedi/simex-mis-specification).

References

  • Alexeeff SE, Carroll RJ, Coull B (2016) Spatial measurement error and correction by spatial SIMEX in linear regression models when using predicted air pollution exposures. Biostatistics 17(2):377–389

    Article  Google Scholar 

  • Brown BW, Mariano RS (1993) Stochastic simulations for inference in nonlinear errors-in-variables models, Handbook of Statistics. New York, North Holland 11:611–627

    Google Scholar 

  • Carroll RJ, Ruppert D, Stefanski LA and Crainiceanu CM (2007) Measurement error in nonlinear models - a modern perspective, CRC Press. https://www.taylorfrancis.com/books/mono/10.1201/9781420010138/measurement-error-nonlinear-models-cipriancrainiceanu-raymond-carroll-leonard-stefanski-david-ruppert

  • Chowdhury S and Sharma AA (2008) simulation based approach for representation of rainfall uncertainty in conceptual rainfall runoff models, Hydrological Research Letters, 25–8. https://www.jstage.jst.go.jp/article/hrl/2/0/2_0_5/_pdf

  • Chowdhury S, Sharma A (2007) Mitigating parameter bias in hydrological modelling due to uncertainty in covariates. J Hydrol 340(3–4):197–204

    Article  Google Scholar 

  • Cook JR, Stefanski LA (1994) Simulation-extrapolation estimation in parametric measurement error models. J Am Stat Assoc 89(428):1314–1328

    Article  Google Scholar 

  • Devanarayan V, Stefanski LA (2002) Empirical simulation extrapolation for measurement error models with replicate measurements. Statist Probab Lett 59(3):219–225

    Article  Google Scholar 

  • Fuller WA (1987) Measurement error models. John Wiley & Sons, New York

    Book  Google Scholar 

  • Gleser LJ (1990) Improvements of the naive approach to estimation in nonlinear errors-in-variables regression models, Statistical Analysis of Error Measurement Models and Application. P. J. Brown and W. A. Fuller, Providence, Rhode Island, American Methematics Society

  • Guolo A (2014) The SIMEX approach to measurement error correction in meta-analysis with baseline risk as covariate. Stat Med 33(12):2062–2076

    Article  Google Scholar 

  • Hasan MM, Sharma A, Johnson F, Mariethoz G and Seed A (2014) Correcting bias in radar Z–R relationships due to uncertainty in point rain gauge networks, J Hydrol, 5191668–1676. https://www.sciencedirect.com/science/article/pii/S0022169414007422

  • Johnson NL, Kotz S, Balakrishnan N (1994) Continuous univariate distributions. John Wiley & Sons, New York

    Google Scholar 

  • Kangas AS (1998) Effect of errors-in-variables on coefficients of a growth model and on prediction of growth. For Ecol Manage 102(2–3):203–212

    Article  Google Scholar 

  • Kinane SM, Montes CR, Albaugh TJ, Mishra DR (2021) A model to estimate leaf area index in loblolly pine plantations using Landsat 5 and 7 images. Remote Sens 13(6):1140

    Article  Google Scholar 

  • Kirtman BP, Min D, Infanti JM, Kinter JL, Paolino DA, Zhang Q, van den Dool H, Saha S, Mendez MP, Becker E, Peng PT, Tripp P, Huang J, DeWitt DG, Tippett MK, Barnston AG, Li SH, Rosati A, Schubert SD, Rienecker M, Suarez M, Li ZE, Marshak J, Lim YK, Tribbia J, Pegion K, Merryfield WJ, Denis B, Wood EF (2014) The North American Multimodel Ensemble Phase-1 seasonal-to-interannual prediction; Phase-2 toward developing intraseasonal prediction. Bull Am Meteor Soc 95(4):585–601

    Article  Google Scholar 

  • Lauzon CB, Crainiceanu C, Caffo BC, Landman BA (2013) Assessment of bias in experimentally measured diffusion tensor imaging parameters using SIMEX. Magn Reson Med 69(3):891–902

    Article  Google Scholar 

  • Lederer W, Seibold H (2019) simex: SIMEX- And MCSIMEX-Algorithm for Measurement Error Models. https://cran.r-project.org/web/packages/simex/simex.pdf

  • Oh EJ, Shepherd BE, Lumley T, Shaw PA (2018) Considerations for analysis of time-to-event outcomes measured with error: bias and correction with SIMEX. Stat Med 37(8):1276–1289

    Article  Google Scholar 

  • Ponzi E, Keller LF, Muff S (2019) The simulation extrapolation technique meets ecology and evolution: a general and intuitive method to account for measurement error. Methods Ecol Evol 10(10):1734–1748

    Article  Google Scholar 

  • R Core Team (2022) R: A Language and Environment for Statistical Computing, Vienna, Austria

  • Stoklosa J, Daly C, Foster SD, Ashcroft MB, Warton DI (2015) A climate of uncertainty: accounting for error in climate variables for species distribution models. Methods Ecol Evol 6(4):412–423

    Article  Google Scholar 

  • Villarini G, Mandapaka PV, Krajewski WF and Moore RJ (2008) Rainfall and sampling uncertainties: a rain gauge perspective. J Geophys Res-Atmos, 113(D11)

  • Villarini G, Krajewski WF (2008) Empirically-based modeling of spatial sampling uncertainties associated with rainfall measurements by rain gauges. Adv Water Resour 31(7):1015–1023

    Article  Google Scholar 

  • Woldemeskel FM, Sharma A, Sivakumar B and Mehrotra R (2014) A framework to quantify GCM uncertainties for use in impact assessment studies. J Hydrol, 5191453–1465. https://www.sciencedirect.com/science/article/pii/S0022169414007069

Download references

Funding

Gabriele Villarini acknowledges support from the USACE Institute for Water Resources. Leonardo V. Noto acknowledges financial support for Dario Treppiedi provided by Consorzio Interuniversitario per l’Idrologia and by Autorità di bacino del Distretto idrografico della Sicilia.

Author information

Authors and Affiliations

  1. IIHR—Hydroscience and Engineering, University of Iowa, Iowa City, IA, 52242, USA

    Gabriele Villarini

  2. Dipartimento Di Ingegneria, Università Degli Studi Di Palermo, Palermo, Italy

    Dario Treppiedi & Leonardo V. Noto

Authors
  1. Gabriele Villarini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dario Treppiedi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Leonardo V. Noto
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

GV. conceptualized the study, and D.T. performed the simulations and prepared the figures. All authors interpreted the results and wrote the manuscript.

Corresponding author

Correspondence to Gabriele Villarini.

Ethics declarations

Competing interests

The authors declare no competing interests.

Ethics approval

Not applicable.

Consent to participate

Not applicable.

Consent for publication

Not applicable.

Conflict of interest

The authors declare no competing interests.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Villarini, G., Treppiedi, D. & Noto, L.V. Sensitivity of the SIMulation-EXtrapolation (SIMEX) methodology to mis-specification of the statistical properties of the measurement errors. Theor Appl Climatol 153, 311–321 (2023). https://doi.org/10.1007/s00704-023-04458-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00704-023-04458-5

Search

Navigation