Abstract
Linear dynamic models, due to their agile structure, are capable to follow and predict fast variations of real-world systems. On the other hand, recovering outcome signals of real-world systems is a straightforward approach to predict them. In this paper, potential of some dynamic linear models—including autoregressive (AR), autoregressive with exogenous inputs (ARX) models and their extended adaptive and evolving versions–are studied in signal recovering. At first, a common signal is represented as summation of some basic temporal functions named TMs (TMs); then, capabilities of the considered models are explained and compared in generating signals with different combinations of TMs. The given explanations and results are supported by theorems, Corollaries, illustrative examples and a real-world example of signal recovering. It is demonstrated that adaptive and particularly evolving AR and ARX models are more capable in signal recovering than regular AR and ARX models. Also, it is proved that if exogenous inputs as incoming signals of an ARX model were not available, under some constraints, there is an AR model which can produce the output of the ARX model. This result is extended for adaptive and evolving AR and ARX models, too.
Similar content being viewed by others
Notes
If the poles of two or more TMs of the outcome signal and incoming signals are equal (similar modes), one can shows that in the outcome signal, a common temporal signal is induced whose order is sum of orders of the pole in similar modes.
References
Angelov P (2006), Machine Learning (Collaborative Systems) UK patent application, GB-0621734.3, 1 Nov 2006
Angelov P, Filev D (2004) An approach to online identification of Takagi Sugeno fuzzy models. IEEE Trans Syst Man Cybern B 34:484–498
Angelov P, Zhou X (2006) Evolving fuzzy systems from data streams in real-time, In: Proc. Int. Symp. on evolving fuzzy systems, pp 29–35
Angelov P, Zhou X (2008), Online learning fuzzy rule-based system structure from data streams, IEEE International Conference on Fuzzy Systems, FUZZ-IEEE, pp 915–922
Angelov P, Filev D, Kasabov(Eds.) N (2010) Evolving intelligent systems: methodology and applications, Wiley
Box GEP, Jenkins GM, Reinsel GC (1994) Time series analysis: forecasting and control, 3rd edn. Prentice-Hall, Englewood Cliffs
EUNITE network (2001), World-wide competition within the EUNITE network: http://www.neuron.tuke.sk/competition. Accessed 23 June 2014
Faruk DÖ (2010) A hybrid neural network and ARIMA model for water quality time series prediction’. Eng Appl Artif Intell 23:586–594
Feriyonika Dewantoro G (2013) Fuzzy sliding mode control for enhancing injection velocity performance in injection molding machine. Int J Artif Intell 10(S13):75–87
Ferreira PJSG (1992) Incomplete sampling series and the recovery of missing samples from oversampled band-limited signals. IEEE Trans Signal Process 40:225–227
Gholipour A, Araabi BN, Lucas C (2006) Predicting chaotic time series using neural and neurofuzzy models: a comparative study, presented at neural processing letters, pp 217–239
Górriz JM, Puntonet CG, Salmerón M, de la Rosa JJG (2004) New model for time-series forecasting using rbf´s and exogenous data. Neural Comput Appl 13:101–111
Hamzaçebi C, Akay D, Kutay F (2009) Comparison of direct and iterative artificial neural network forecast approaches in multi-periodic time series forecasting. Expert Syst Appl 36:3839–3844
Hirabayashi A (2007) Consistent sampling and signal recovery. IEEE Trans Signal Process 55:4104–4115
Joelianto E, Anura DC, Priyanto M (2013) ANFIS—hybrid reference control for improving transient response of controlled systems using PID controller. Int J Artif Intell 10(S13):88–111
Kalhor A (2014) A self tuning regulator for nonlinear time varying control systems based on evolving linear models. IEEE Evolving and Adaptive Intelligent Systems, Linz
Kalhor A, Araabi BN, Lucas C (2010) An online predictor model as adaptive habitually linear and transiently nonlinear model’. Evol Syst 1(1):29–41
Kalhor A, Iranmanesh H, Abdollahzade M (2012) Online modeling of real-world time series through evolving AR models’, WCCI 2012 IEEE World Congress on Computational Intelligence, June, Brisbane
Kalhor A, Araabi BN, Lucas C (2013a) Reducing the number of local linear models in neuro–fuzzy modeling: a split-and-merge clustering approach’. Appl Soft Comput J 13:939–946
Kalhor A, Araabi BN, Lucas C (2013b) Online extraction of main linear trends for nonlinear time varying processes. Inf Sci 220:22–33
Kasabov N (2002) DENFIS: dynamic evolving neural fuzzy inference system and its application for time series prediction. IEEE Trans Fuzzy Syst 10:144–154
Khashei M, Hejazi SR, Bijar M (2008) A new hybrid artificial neural networks and fuzzy regression model for time series forecasting original research article. Fuzzy Sets Syst 159:769–786
Lughofer ED (2008) FLEXFIS: a robust incremental learning approach for evolving Takagi-Sugeno Fuzzy models. IEEE Trans Fuzzy Syst 16:1393–1410
Makridakis SG, Wheelwright SC, Hyndman RJ (1998) Forecasting: Methods and Applications, Wiley
Mills TC (1990) Time series techniques for economists. University Press, Cambridge
Moura, M das C, Zio E, Lins ID, Droguett E (2011) Failure and reliability prediction by support vector machines regression of time series data. Reliab Eng Syst Saf 96:1527–1534
Needella D, Troppb JA (2009) CoSaMP: iterative signal recovery from incomplete and inaccurate samples’. Appl Comput Harmon Anal 26:301–321
Nguyen TM, Wu QMJ (2013) A fuzzy logic model based Markov random field for medical image segmentation. Evol Syst 4(3):171–181
Nunn I, White T (2005) The application of antigenic search techniques to time series forecasting, In GECCO ‘05. In: Proceedings of the 2005 conference on Genetic and evolutionary computation, New York, pp 353–360
Odior AO (2013) Application of neural network and fuzzy model to grinding process control. Evol Syst 4(3):195–201
Ogata K (1994) Discrete-time control systems, 2nd edn. Prentice Hall, Englewood Cliffs
Oppenheim AV, Willsky AS, Hamid S (1996) Signals and systems, 2nd edn. Prentice Hall, NJ
Platt J (1991) A resource-allocating network for function interpolation. Neural Comput 3:213–225
Preitl S, Precup RE, Fodor J, Bede B (2006) Iterative feedback tuning in fuzzy control systems, theory and applications. Acta Polytechnica Hungarica 3(3):81–96
Qui PY, Huang ZT, Jiang WL, Zhang C (2008) Improved blind-spreading sequence estimation algorithm for direct sequence spread spectrum signals’. Signal Processing, IET 2:139–146
Rezaii TY, Tinati MA, Beheshti S (2013) Adaptive efficient sparse estimator achieving oracle properties. Signal Process IET 7:259–268
Salmerón M, Ortega J, Puntonet CG, Prieto A (2001) Improved ran sequential prediction using orthogonal techniques. Neurocomputing 41:153–172
Skrjanc I, Blazic S, Matko D (2002) Direct fuzzy model-reference adaptive control. Int J Intell Syst 17(10):943–963
Skrjanc I, Blazic B, Agamennoni OE (2005) Identification of dynamical systems with a robust interval fuzzy model. Automatica 41(2):327–332
Tay FEH, Cao LJ (2002) Modified support vector machines in financial time series forecasting. Neurocomputing 48:847–861
Tomescu ML, Preitl S, Precup RE, Tar JK (2007) Stability analysis method for fuzzy control systems dedicated controlling nonlinear processes. Acta Polytechnica Hungarica 4(3):127–141
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kalhor, A. Potential of evolving AR and ARX models in signal recovering. Evolving Systems 7, 61–72 (2016). https://doi.org/10.1007/s12530-014-9114-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12530-014-9114-0