Abstract
A common goal in modeling and data mining is to determine, based on sample data, whether or not a change of some sort has occurred in a quantity of interest. The study of statistical problems of this nature is typically referred to as change point analysis. Though change point analysis originated nearly 70 years ago, it is still an active area of research and much effort has been put forth to develop new methodology and discover new applications to address modern statistical questions. In this paper we survey some classical results in change point analysis and recent extensions to time series, multivariate, panel and functional data. We also present real data examples which illustrate the utility of the surveyed results.
Similar content being viewed by others
References
Albin JMP, Jarušková D (2003) On a test statistic for linear trend. Extremes 6:247–258
Andreou E, Ghysels E (2002) Detecting multiple breaks in financial market volatility dynamics. J Appl Econom 17:579–600
Andrews DWK (1993) Tests for parameter instability and structural change with unknown change point. Econometrica 61:821–856
Aston J, Kirch C (2012a) Evaluating stationarity via change-point alternatives with applications to fmri data. Ann Appl Stat 6:1906–1948
Aston J, Kirch C (2012b) Detecting and estimating changes in dependent functional data. J Multivar Anal 109:204–220
Aue A, Horváth L (2004) Delay time in sequential detection of change. Stat Prob Lett 67:221–231
Aue A, Horváth L, Hušková M, Kokoszka P (2006a) Change-point monitoring in linear models with conditionally heteroscedastic errors. Econom J 9:373–403
Aue A, Berkes I, Horváth L (2006b) Strong approximation for the sums of squares of augmented garch sequences. Bernoulli 12:583–608
Aue A, Horváth L, Hušková M, Kokoszka P (2008a) Testing for changes in polynomial regression. Bernoulli 14:637–660
Aue A, Horváth L, Kokoszka P, Steinebach JG (2008b) Monitoring shifts in mean: asymptotic normality of stopping times. Test 17:515–530
Aue A, Horváth L, Hušková M (2009a) Extreme value theory for stochastic integrals of legendre polynomials. J Multivar Anal 100:1029–1043
Aue A, Horváth L, Hušková M, Ling S (2009b) On distinguishing between random walk and changes in the mean alternatives. Econom Theory 25:411–441
Aue A, Hörmann S, Horváth L, Reimherr M (2009c) Break detection in the covariance structure of multivariate time series models. Ann Stat 37:4046–4087
Aue A, Horváth L, Hušková M (2012) Segmenting mean-nonstationary time series via trending regression. J Econom 168:367–381
Aue A, Horváth L (2013) Structural breaks in time series. J Time Ser Anal 34:1–16
Aue A, Dienes C, Fremdt S, Steinebach JG (2014) Reaction times of monitoring schemes for ARMA time series. Bernoulli (to appear)
Bai J (1999) Likelihood ratio test for multiple structural changes. J Econom 91:299–323
Bai J (2010) Common breaks in means and variances for panel data. J Econom 157:78–92
Baltagi BH, Kao C, Liu L (2012) Estimation and identification of change points in panel models with nonstationary or stationary regressors and error terms. Preprint.
Bartram SM, Brown G, Stulz RM (2012) Why are us stocks more volatile? J Finance 67:1329–1370
Batsidis A, Horváth L, Martín N, Pardo L, Zografos K (2013) Change-point detection in multinomial data using phi-convergence test statistics. J Multivar Anal 118:53–66
Berkes I, Philipp W (1977) An almost sure invariance principle for the empirical distribution function of mixing random variables. Zeitschrift für Wahrscheinlichtkeitstheorie und verwandte Gebiete 41:115–137
Berkes I, Philipp W (1979) Approximation theorems for independent and weakly dependent random vectors. Ann Prob 7:29–54
Berkes I, Horváth L (2001) Strong approximation of the empirical process of garch sequences. Ann Appl Prob 11:789–809
Berkes I, Horváth L (2002) Empirical processes of residuals. In: Dehling H, Mikosch T, Sorensen M (eds) Empirical process techniques for dependent data. Birkhäuser, Basel, pp 195–209
Berkes I, Horváth L (2003) Limit results for the empirical process of squared residuals in garch models. Stoc Process Appl 105:271–298
Berkes I, Horváth L, Kokoszka P (2004a) Testing for parameter constancy in GARCH(\(p\), \(q\)) models. 70: 263–273
Berkes I, Gombay E, Horváth L, Kokoszka P (2004b) Sequential change-point detection in garch\((p, q)\) models. Econom Theory 20:1140–1167
Berkes I, Horváth L, Hušková M, Steinebach M (2004c) Applications of permutations to the simulation of critical values. J Nonparamet Stat 16:197–216
Berkes I, Horváth L, Kokoszka P, Shao Q-M (2006) On discriminating between long-range dependence and changes in the mean. Ann Stat 34:1140–1165
Berkes I, Hörmann S, Horváth L (2008) The functional central limit theorem for a family of garch observations with applications. Stat Prob Lett 78:2725–2730
Berkes I, Hörmann S, Schauer J (2009a) Asymptotic results for the empirical process of stationary sequences. Stoch Process Appl 119:1298–1324
Berkes I, Gabrys R, Horváth L, Kokoszka P (2009b) Detecting changes in the mean of functional observations. J R Stat Soc Ser B 70:927–946
Berkes I, Gombay E, Horváth L (2009c) Testing for changes in the covariance structure of linear processes. J Stat Plan Inference 139:2044–2063
Berkes I, Liu W, Wu WB (2014) Komlós–major–tusnády approximation under dependence. Ann Prob 42:794–817
Billingsley P (1968) Convergence probability measures. Wiley, New York
Blum JR, Kiefer J, Rosenblatt M (1961) Distribution free tests of independence based on the sample distribution function. Ann Math Stat 32:485–498
Bosq D (2000) Linear processes in function spaces. Springer, New York
Bradley RC (2007) Introduction to strong mixing conditions, vol 1–3. Kendrick Press, Heber City
Brockwell PJ, Davis RA (1991) Time series: theory and methods, 2nd edn. Springer, New York
Busetti F, Taylor AMR (2004) Tests of stationarity against a change in persistence. J Econom 123:33–66
Carrion-i-Silvestre JL, Kim D, Perron P (2009) Gls-based unit root tests with multiple structural breaks both under the null and the alternative hypotheses. Econom Theory 25:1754–1792
Černíková A, Hušková M, Prášková Z, Steinebach J (2013) Delay time in monitoring jump changes in linear models. Statistics 47:1–25
Chan J, Horváth L, Hušková M (2013) Darling–erdős limit results for change-point detection in panel data. J Stat Plan Inference 143:955–970
Chochola O, Hušková M, Prášková Z, Steinebach JG (2013) Robust monitoring of capm portfolio betas. J Multivar Anal 115:374–396
Chu C-SJ, Stinchcombe M, White H (1996) Monitoring structural change. Econometrica 64:1045–1065
Chung KL, Williams RJ (1983) Introduction to stochastic integration. Birkhäuser, Boston
Csáki E (1986) Some applications of the classical formula on ruin probabilities. J Stat Plan Inference 14:35–42
Csörgő M, Révész P (1981) Strong approximations in probability and statistics. Academic Press, New York
Csörgő M, Horváth L (1987) Nonparametric tests for the changepoint problem. J Stat Plan Inference 17:1–9
Csörgő M, Horváth L (1993) Weighted approximations in probability and statistics. Wiley, Chichester
Csörgő M, Horváth L (1997) Limit theorems in change-point analysis. Wiley, Chichester
Cuevas A (2014) A partial overview of the theory of statistics with functional data. J Stat Plan Inference 147:1–23
Darling DA, Erdős P (1956) A limit theorem for the maximum of normalized sums of independent random variables. Duke Math J 23:143–155
Davis RA, Huang D, Yao Y-C (1995) Testing for a change in the parameter values and order of an autoregressive model. Ann Stat 23:282–304
Davis RA, Lee TC, Rodriguez-Yam G (2008) Break detection for a class of nonlinear time series models. J Time Ser Anal 29:834–867
Dedecker I, Doukhan P, Lang G, León JRR, Louhichi S, Prieur C (2007) Weak dependence with examples and applications. Lecture Notes in Statistics. Springer, Berlin
Dehling H, Fried R (2012) Asymptotic distribution of two-sample empirical \(u\)-quantiles with applications to robust tests for shifts in location. J Multivar Anal 105:124–140
Dominicy Y, Hörmann S, Ogata H, Veredas D (2013) On sample marginal quantiles for stationary processes. Stat Prob Lett 83:28–36
Doukhan P (1994) Mixing: properties and examples, vol 85. Lecture Notes in Statistics. Springer, Berlin
Dutta K, Sen PK (1971) On the bahadur representation of sample quantiles in some stationary multivariate autoregressive processes. J Multivar Anal 1:186–198
Eberlein E (1986) On strong invariance principles under dependence assumptions. Ann Prob 14:260–270
Ferraty F, Romain Y (2011) Oxford handbook of functional data analysis. Oxford University Press, Oxford
Francq Z, Zakoïan J-M (2010) GARCH models. Wiley, Chichester
Fremdt S (2013) Page’s sequential procedure for change-point detection in time series regression. http://arxiv.org/abs/1308.1237
Fremdt S (2014) Asymptotic distribution of delay time in page’s sequential procedure. J Stat Plan Inference 145:74–91
Gombay E (1994) Testing for change-points with rank and sign statistics. Stat Prob Lett 20:49–56
Gombay E, Horváth L (1996) On the rate of approximations for maximum likelihood tests in change-point models. J Multivar Anal 56:120–152
Gombay E, Horváth L, Hušková M (1996) Estimators and tests for change in variances. Stat Decis 14:145–159
Gombay E, Hušková M (1998) Rank based estimators of the change point. J Stat Plan Inference 67:137–154
Gombay E (2000) \(u\)-statistics for sequential change-detection. Metrika 54:133–145
Gombay E (2001) \(u\)-statistics for change under alternative. J Multivar Anal 78:139–158
Hansen BE (1992) Tests for parameter instability in regression with \(i(1)\) processes. J Bus Econom Stat 10:321–335
Hansen BE (2000) Testing for structural change in conditional models. J Econom 97:93–115
Harvey DI, Leybourne SJ, Taylor AMR (2013) Testing for unit roots in the possible presence of multiple trend breaks using minimum dickey–fuller statistics. J Econom 177:265–284
Hidalgo J, Seo MH (2013) Testing for structural stability in the whole sample. J Econom 175:84–93
Hlávka Z, Hušková M, Kirch C, Meintanis S (2012) Monitoring changes in the error distribution of autoregressive models based on fourier methods. TEST 21(2012):605–634
Hörmann S, Kokoszka P (2010) Weakly dependent functional data. Ann Stat 38:1845–1884
Hörmann S, Horváth L, Reeder R (2013) A functional version of the arch model. Econom Theory 29:267–288
Horn RA, Johnson AMD (1991) Topics in matrix analysis. Cambridge University Press, Cambridge
Horváth L (1984) Strong approximation of renewal processes. Stoch Process Appl 18:127–138
Horváth L (1993) The maximum likelihood method for testing changes in the parameters of normal observations. Ann Stat 21:671–680
Horváth L (1995) Detecting changes in linear regressions. Statistics 26:189–208
Horváth L, Serbinowska M (1995) Testing for changes in multinomial observations: the lindisfarnne scribes problem. Scand J Stat 22:371–384
Horváth L, Hušková M, Serbinowska M (1997) Estimators for the time of change in linear models. Statistics 29:109–130
Horváth L, Kokoszka P, Steinebach J (1999) Testing for changes in multivariate dependent observations with an application to temperature changes. J Multivar Anal 68:96–119
Horváth L, Hušková M, Kokoszka P, Steinebach J (2004) Monitoring changes in linear models. J Stat Plan Inference 126:225–251
Horváth L, Hušková M (2005) Testing for changes using permutations of \(u\)-statistics. J Stat Plan Inference 128:351–371
Horváth L, Kokoszka P, Steinebach J (2007) On sequential detection of parameter changes in linear regression. Stat Prob Lett 77:885–895
Horváth L, Horváth Zs, Hušková M (2008) Ratio tests for change point detection. In: Beyond parametrics in interdisciplinary research. IMS, Collections, 1:293–304
Horváth L, Hušková M, Kokoszka P (2010) Testing the stability of the functional autoregressive model. J Multivar Anal 101:352–367
Horváth L, Hušková M (2012) Change-point detection in panel data. J Time Ser Anal 33:631–648
Horváth L, Kokoszka P (2012) Inference for functional data with applications. Springer, New York
Horváth L, Hušková M, Wang J (2013a) Estimation of the time of change in panel data. Preprint
Horváth L, Kokoszka P, Reeder R (2013b) Estimation of the mean of of functional time series and a two sample problem. J R Stat Soc Ser B 75:103–122
Horváth L, Trapani L (2013) Statistical inference in a random coefficient panel model. Preprint
Horváth L, Kokoszka P, Rice G (2014) Testing stationarity of functional data. J Econom 179:66–82
Hsiao C (2007) Panel data analysis—advantages and challenges. TEST 16:1–22
Hsu DA (1979) Detecting shifts of parameter in gamma sequences with applications to stock prices and air traffic flow analysis. J Am Stat Assoc 74:31–40
Hušková M (1996) Estimation of a change in linear models. Stat Prob Lett 26:13–24
Hušková M (1997a) Limit theorems for rank statistics. Stat Prob Lett 32:45–55
Hušková M (1997b) Multivariate rank statistics processes and change point analysis. In: Applied statistical sciences III, Nova Science Publishers, New York, pp 83–96
Hušková M, Picek J (2005) Bootstrap in detection of changes in linear regression. Sankhya Ser B 67:1–27
Hušková M, Prášková Z, Steinebach J (2007) On the detection of changes in autoregressive time series, i. asymptotics. J Stat Plan Inference 137:1243–1259
Hušková M, Kirch C, Prašková Z, Steinebach J (2008) On the detection of changes in autoregressive time series, ii. resampling procedures. J Stat Plan Inference 138:1697–1721
Hušková M, Kirch C (2012) Bootstrapping sequential change-point tests for linear regression. Metrika 75:673–708
Hušková M (2013) Robust change point analysis. In: Robustness and complex data structures, Springer, Berlin pp 171–190
Iacone F, Leybourne SJ, Taylor AMR (2013) Testing for a break in trend when the order of integration is unknown. J Econom 176:30–45
Im KS, Pesaran MH, Shin Y (2003) Testing for unit roots in heterogeneous panels. J Econom 115:53–74
Inclán C, Tiao GC (1994) Use of cumulative sums of squares for retrospective detection of change of variance. J Amer Stat Assoc 89:913–923
Jandhyala VK, MacNeill IB (1997) Iterated partial sum sequences of regression residuals and tests for changepoints with continuity constraints. J R Stat Soc Ser B 59:147–156
Jarušková D (1998) Testing appearance of linear trend. J Stat Plan Inference 70:263–276
Jarušková D (1999) Testing appearance of polynomial trend. Extremes 2:25–37
Kargin V, Onatski A (2008) Curve forecasting by functional autoregression. J Multivar Anal 99:2508–2526
Kiefer J (1959) \(k\)-sample analogues of the kolmogorov–smirnov and cramér-v. mises tests. Ann Math Stat 30:420–447
Kim JY (2000) Detection of change in persistence of a linear time series. J Econom 95:97–116
Kim JY, Belaire-French J, Badillo AR (2002) Corringendum to “detection of change in persistence of a linear time series”. J Econom 109:389–392
Kirch C, Steinebach J (2006) Permutation principles for the change analysis of stochastic processes under strong invariance. J Comput Appl Math 186:64–88
Kirch C (2007a) Resampling in the frequency domain of time series to determine critical values for change-point tests. Stat Decis 25:237–261
Kirch C (2007b) Block permutation principles for the change analysis of dependent data. J Stat Plan Inference 137:2453–2474
Kirch C, Politis DN (2011) Tft-bootstrap: resampling time series in the frequency domain to obtain replicates in the time domain. Ann Stat 39:1427–1470
Kirch C, Tadjuidje Kamgaing J (2012) Testing for parameter stability in nonlinear autoregressive models. J Time Ser Anal 33:365–385
Kokoszka P, Leipus R (2000) Change-point estimation in arch models. Bernoulli 6:513–539
Kuang C-M (1998) Tests for changes in models with a polynomial trend. J Econom 84:75–91
Lee S, Park S (2001) The cusum of squares test for scale changes in infinite order moving average processes. Scand J Stat 28:625–644
Liu W, Wu WB (2010) Asymptotics of spectral density estimates. Econom Theory 26:1218–1245
Louhichi S (2000) Weak convergence for empirical processes of associated sequences. Annales de l’Institut Henri Poincaré Probabilités et Statistiques 36:547–567
Ng S (2008) A simple test for nonstationarity in mixed panels. J Bus Econ Stat 26:113–126
Oberhofer W, Haupt H (2005) The asymptotic distribution of the unconditional quantile estimator under dependence. Stat Prob Lett 73:243–250
Page ES (1954) Continuous inspection schemes. Biometrika 41:100–105
Page ES (1955) A test for a change in a parameter occurring at an unknown point. Biometrika 42:523–526
Quandt RE (1958) Tests of the hypothesis that a linear regression system obeys two separate regimes. J Am Stat Assoc 53:873–880
Quandt RE (1960) The estimation of the parameters of a linear regression system obeying two separate regimes. J Am Stat Assoc 55:324–330
Ramsay JO, Hooker G, Graves S (2009) Functional data analysis with R and MATLAB. Springer, New York
Sen PK (1968) Asymptotic normality of sample quantiles for \(m\)-dependent processes. Ann Math Stat 39:1724–1730
Shao QM, Yu H (1996) Weak convergence for weighted empirical processes of dependent sequences. Ann Prob 24:2098–2127
Shorack GR, Wellner JA (1986) Empirical processes with applications to statistics. Wiley, New York
Taniguchi M, Kakizawa Y (2000) Asymptotic theory of statistical inference for time series. Springer, New York
Westerlund J, Larsson R (2012) Testing for a unit root in a random coefficient panel data model. J Econom 167:254–273
Wied D, Krämer W, Dehling H (2012) Testing for a change in correlation at an unknown point in time using an extended functional delta method. Econom Theory 28:570–589
Wied D, Dehling H, van Kampen M, Vogel D (2014) A fluctuation test for constant Spearman’s rho with nuisance-free limit distribution. Comput Stat Data Anal (to appear)
Wolfe DA, Schechtman E (1984) Nonparametric statistical procedures for the changepoint problem. J Stat Plan Inference 9:389–396
Wright JH (1996) Structural stability tests in the linear regression model when the regressors have roots local to unity. Econ Lett 52:257–262
Wu WB (2005) On the bahadur representation of sample quantiles for dependent sequences. Ann Stat 33:1934–1963
Yu H (1993) A glivenko–cantelli lemma and weak convergence for empirical processes of associated sequences. Prob Theory Relat Fields 95:357–370
Acknowledgments
We are grateful to Marie Hušková, Stefan Fremdt and the participants of the Time Series Seminar at the University of Utah for pointing out mistakes in the earlier versions of this paper and to Daniela Jarušková and Brad Hatch for some of the data sets.
Author information
Authors and Affiliations
Corresponding author
Additional information
Research supported by NSF grant DMS 1305858.
This invited paper is discussed in comments available at: doi:10.1007/s11749-014-0367-5, doi:10.1007/s11749-014-0369-3, doi:10.1007/s11749-014-0370-x, doi:10.1007/s11749-014-0371-9, doi:10.1007/s11749-014-0372-8, doi:10.1007/s11749-014-0373-7, doi:10.1007/s11749-014-0376-4, doi:10.1007/s11749-014-0377-3.
Rights and permissions
About this article
Cite this article
Horváth, L., Rice, G. Extensions of some classical methods in change point analysis. TEST 23, 219–255 (2014). https://doi.org/10.1007/s11749-014-0368-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11749-014-0368-4