Skip to main content
Log in

Potential of evolving AR and ARX models in signal recovering

  • Original Paper
  • Published:
Evolving Systems Aims and scope Submit manuscript

Abstract

Linear dynamic models, due to their agile structure, are capable to follow and predict fast variations of real-world systems. On the other hand, recovering outcome signals of real-world systems is a straightforward approach to predict them. In this paper, potential of some dynamic linear models—including autoregressive (AR), autoregressive with exogenous inputs (ARX) models and their extended adaptive and evolving versions–are studied in signal recovering. At first, a common signal is represented as summation of some basic temporal functions named TMs (TMs); then, capabilities of the considered models are explained and compared in generating signals with different combinations of TMs. The given explanations and results are supported by theorems, Corollaries, illustrative examples and a real-world example of signal recovering. It is demonstrated that adaptive and particularly evolving AR and ARX models are more capable in signal recovering than regular AR and ARX models. Also, it is proved that if exogenous inputs as incoming signals of an ARX model were not available, under some constraints, there is an AR model which can produce the output of the ARX model. This result is extended for adaptive and evolving AR and ARX models, too.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. If the poles of two or more TMs of the outcome signal and incoming signals are equal (similar modes), one can shows that in the outcome signal, a common temporal signal is induced whose order is sum of orders of the pole in similar modes.

References

  • Angelov P (2006), Machine Learning (Collaborative Systems) UK patent application, GB-0621734.3, 1 Nov 2006

  • Angelov P, Filev D (2004) An approach to online identification of Takagi Sugeno fuzzy models. IEEE Trans Syst Man Cybern B 34:484–498

    Article  Google Scholar 

  • Angelov P, Zhou X (2006) Evolving fuzzy systems from data streams in real-time, In: Proc. Int. Symp. on evolving fuzzy systems, pp 29–35

  • Angelov P, Zhou X (2008), Online learning fuzzy rule-based system structure from data streams, IEEE International Conference on Fuzzy Systems, FUZZ-IEEE, pp 915–922

  • Angelov P, Filev D, Kasabov(Eds.) N (2010) Evolving intelligent systems: methodology and applications, Wiley

  • Box GEP, Jenkins GM, Reinsel GC (1994) Time series analysis: forecasting and control, 3rd edn. Prentice-Hall, Englewood Cliffs

    MATH  Google Scholar 

  • EUNITE network (2001), World-wide competition within the EUNITE network: http://www.neuron.tuke.sk/competition. Accessed 23 June 2014

  • Faruk DÖ (2010) A hybrid neural network and ARIMA model for water quality time series prediction’. Eng Appl Artif Intell 23:586–594

    Article  Google Scholar 

  • Feriyonika Dewantoro G (2013) Fuzzy sliding mode control for enhancing injection velocity performance in injection molding machine. Int J Artif Intell 10(S13):75–87

    Google Scholar 

  • Ferreira PJSG (1992) Incomplete sampling series and the recovery of missing samples from oversampled band-limited signals. IEEE Trans Signal Process 40:225–227

    Article  Google Scholar 

  • Gholipour A, Araabi BN, Lucas C (2006) Predicting chaotic time series using neural and neurofuzzy models: a comparative study, presented at neural processing letters, pp 217–239

  • Górriz JM, Puntonet CG, Salmerón M, de la Rosa JJG (2004) New model for time-series forecasting using rbf´s and exogenous data. Neural Comput Appl 13:101–111

    Article  Google Scholar 

  • Hamzaçebi C, Akay D, Kutay F (2009) Comparison of direct and iterative artificial neural network forecast approaches in multi-periodic time series forecasting. Expert Syst Appl 36:3839–3844

    Article  Google Scholar 

  • Hirabayashi A (2007) Consistent sampling and signal recovery. IEEE Trans Signal Process 55:4104–4115

    Article  MathSciNet  Google Scholar 

  • Joelianto E, Anura DC, Priyanto M (2013) ANFIS—hybrid reference control for improving transient response of controlled systems using PID controller. Int J Artif Intell 10(S13):88–111

    Google Scholar 

  • Kalhor A (2014) A self tuning regulator for nonlinear time varying control systems based on evolving linear models. IEEE Evolving and Adaptive Intelligent Systems, Linz

    Book  Google Scholar 

  • Kalhor A, Araabi BN, Lucas C (2010) An online predictor model as adaptive habitually linear and transiently nonlinear model’. Evol Syst 1(1):29–41

    Article  Google Scholar 

  • Kalhor A, Iranmanesh H, Abdollahzade M (2012) Online modeling of real-world time series through evolving AR models’, WCCI 2012 IEEE World Congress on Computational Intelligence, June, Brisbane

  • Kalhor A, Araabi BN, Lucas C (2013a) Reducing the number of local linear models in neuro–fuzzy modeling: a split-and-merge clustering approach’. Appl Soft Comput J 13:939–946

    Article  Google Scholar 

  • Kalhor A, Araabi BN, Lucas C (2013b) Online extraction of main linear trends for nonlinear time varying processes. Inf Sci 220:22–33

    Article  Google Scholar 

  • Kasabov N (2002) DENFIS: dynamic evolving neural fuzzy inference system and its application for time series prediction. IEEE Trans Fuzzy Syst 10:144–154

    Article  Google Scholar 

  • Khashei M, Hejazi SR, Bijar M (2008) A new hybrid artificial neural networks and fuzzy regression model for time series forecasting original research article. Fuzzy Sets Syst 159:769–786

    Article  MATH  Google Scholar 

  • Lughofer ED (2008) FLEXFIS: a robust incremental learning approach for evolving Takagi-Sugeno Fuzzy models. IEEE Trans Fuzzy Syst 16:1393–1410

    Article  Google Scholar 

  • Makridakis SG, Wheelwright SC, Hyndman RJ (1998) Forecasting: Methods and Applications, Wiley

  • Mills TC (1990) Time series techniques for economists. University Press, Cambridge

    Google Scholar 

  • Moura, M das C, Zio E, Lins ID, Droguett E (2011) Failure and reliability prediction by support vector machines regression of time series data. Reliab Eng Syst Saf 96:1527–1534

    Article  Google Scholar 

  • Needella D, Troppb JA (2009) CoSaMP: iterative signal recovery from incomplete and inaccurate samples’. Appl Comput Harmon Anal 26:301–321

    Article  MathSciNet  Google Scholar 

  • Nguyen TM, Wu QMJ (2013) A fuzzy logic model based Markov random field for medical image segmentation. Evol Syst 4(3):171–181

    Article  Google Scholar 

  • Nunn I, White T (2005) The application of antigenic search techniques to time series forecasting, In GECCO ‘05. In: Proceedings of the 2005 conference on Genetic and evolutionary computation, New York, pp 353–360

  • Odior AO (2013) Application of neural network and fuzzy model to grinding process control. Evol Syst 4(3):195–201

    Article  Google Scholar 

  • Ogata K (1994) Discrete-time control systems, 2nd edn. Prentice Hall, Englewood Cliffs

    Google Scholar 

  • Oppenheim AV, Willsky AS, Hamid S (1996) Signals and systems, 2nd edn. Prentice Hall, NJ

  • Platt J (1991) A resource-allocating network for function interpolation. Neural Comput 3:213–225

    Article  MathSciNet  Google Scholar 

  • Preitl S, Precup RE, Fodor J, Bede B (2006) Iterative feedback tuning in fuzzy control systems, theory and applications. Acta Polytechnica Hungarica 3(3):81–96

    Google Scholar 

  • Qui PY, Huang ZT, Jiang WL, Zhang C (2008) Improved blind-spreading sequence estimation algorithm for direct sequence spread spectrum signals’. Signal Processing, IET 2:139–146

    Article  Google Scholar 

  • Rezaii TY, Tinati MA, Beheshti S (2013) Adaptive efficient sparse estimator achieving oracle properties. Signal Process IET 7:259–268

    Article  MathSciNet  Google Scholar 

  • Salmerón M, Ortega J, Puntonet CG, Prieto A (2001) Improved ran sequential prediction using orthogonal techniques. Neurocomputing 41:153–172

    Article  MATH  Google Scholar 

  • Skrjanc I, Blazic S, Matko D (2002) Direct fuzzy model-reference adaptive control. Int J Intell Syst 17(10):943–963

    Article  MATH  Google Scholar 

  • Skrjanc I, Blazic B, Agamennoni OE (2005) Identification of dynamical systems with a robust interval fuzzy model. Automatica 41(2):327–332

    Article  MathSciNet  MATH  Google Scholar 

  • Tay FEH, Cao LJ (2002) Modified support vector machines in financial time series forecasting. Neurocomputing 48:847–861

    Article  MATH  Google Scholar 

  • Tomescu ML, Preitl S, Precup RE, Tar JK (2007) Stability analysis method for fuzzy control systems dedicated controlling nonlinear processes. Acta Polytechnica Hungarica 4(3):127–141

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ahmad Kalhor.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kalhor, A. Potential of evolving AR and ARX models in signal recovering. Evolving Systems 7, 61–72 (2016). https://doi.org/10.1007/s12530-014-9114-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12530-014-9114-0

Keywords

Navigation