Skip to main content
SpringerLink
Log in

Fast RLS-Like Algorithm for Generalized Eigendecomposition and its Applications

  • Published:
Journal of VLSI signal processing systems for signal, image and video technology Aims and scope Submit manuscript

Abstract

Generalized eigendecomposition (GED) plays a vital role in many signal-processing applications. In this paper, we will propose a new method for computing the generalized eigenvectors, which is on-line and resembles the RLS algorithm for Wiener filtering. We further present a proof to show convergence to the exact solution and simulations have shown that the algorithm is faster than most of the traditional methods. This algorithm belongs to the class of fixed-point algorithms and hence does not require any external step-size parameters like the gradient-based methods. Simulations are performed on synthetic data and compared with other algorithms found in literature. Finally we will demonstrate the application of GED in the design of a CDMA receiver for direct-sequence spread spectrum signals.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. R.O. Duda and P.E. Hart, Pattern Classification and Scene Analysis, New York: Wiley, 1973.

    MATH  Google Scholar 

  2. J. Mao and A.K. Jain, “Artificial Neural Networks for Feature Extraction and Multivariate Data Projection,” IEEE Transactions on Neural Networks, vol. 6, no. 2, 1995.

  3. G.H. Golub and C.F. Van Loan, Matrix Computations, The John Hopkins University Press, 1991.

  4. T.D. Sanger, “Optimal Unsupervised Learning in a Single-Layer Linear Feedforward Neural Network,” Neural Networks, vol. 12, 1989, pp. 459-473.

    Article  MATH  Google Scholar 

  5. J. Rubner and P. Tavan, “A Self-Organizing Network for Principal Component Analysis,” Europhysics Letters, vol. 10, no. 7, 1989, pp. 693-698.

    Article  Google Scholar 

  6. J. Rubner and P. Tavan, “Development of Feature Detectors by Self Organization,” Biol. Cybern., vol. 62, 1990, pp. 193-199.

    Article  Google Scholar 

  7. K.I. Diamantaras and S.Y. Kung, Principal Component Neural Networks, Theory and Applications, New York: Wiley, 1996.

    MATH  Google Scholar 

  8. Y.N. Rao and J.C. Principe, “A Fast On-Line Algorithm for PCA and its Convergence Characteristics,” in Proc. IEEE Workshop on Neural Networks for Signal Processing X, Dec. 2000, pp. 299-308.

  9. Y.N. Rao and J.C. Principe, “A Fast On-line Generalized Eigendecomposition Algorithm for Time Series Segmentation,” in Symposium 2000: Adaptive Systems for Signal Processing, Communications and Control (AS-SPCC), Oct. 2000, pp. 266-271.

  10. Y.N. Rao and J.C. Principe, “Time Series Segmentation Using a Novel Adaptive Eigendecomposition Algorithm,” Journal of VLSI Signal Processing vol. 32, 2002, pp. 7-17.

    Article  MATH  Google Scholar 

  11. C. Chatterjee, V.P. Roychowdhury, J. Ramos, and M.D. Zoltowski, “Self-Organizing Algorithms for Generalized Eigendecomposition,” IEEE Transactions on Neural Networks, vol. 8, no. 6, Nov. 1997, pp. 1518-1530.

    Article  Google Scholar 

  12. D. Xu, J.C. Principe, and H.C. Wu, “Generalized Eigendecomposition with an On-line Local Algorithm,” IEEE Signal Processing Letters, vol. 5, no. 11, 1998.

  13. G. Mathew and V.U. Reddy, “A Quasi-Newton Adaptive Algorithm for Generalized Symmetric Eigenvalue Problem,” IEEE Trans. Signal Proc., vol. 44, no. 10, 1996.

    Google Scholar 

  14. K.I. Diamantaras and S.Y. Kung, “An Unsupervised Neural Model For Oriented Principal Component Extraction,” Proc. International Conf on Acoustics, Speech and Signal Proc., vol. 2, 1991, pp. 1049-1052.

    Google Scholar 

  15. Y. Hua, Y. Xiang, T. Chen, K. Abed-Meraim, and Y. Miao, “Natural Power Method for Fast Subspace Tracking,” Proc. IEEE Workshop on Neural Networks for Signal Processing IX, Aug. 1999, pp. 176-185.

  16. T.F. Wong, T.M. Lok, J.S. Lehnert, and M.D. Zoltowski, “A Linear Receiver for Direct-Sequence Spread-Spectrum Multiple-Access Systems with Antenna Arrays and Blind Adaptation,” IEEE Trans. Information Theory, vol. 44, no. 2, March 1998, pp. 659-676.

    Article  MathSciNet  MATH  Google Scholar 

  17. F. Deprettere (Ed.) SVD and Signal Processing-Algorithms, Applications and Architectures, Amsterdam: North-Holland, 1988.

    Google Scholar 

  18. Y. Cao, S. Sridharan, and M. Moody, “Multichannel Speech Separation by Eigendecomposition and its Application to Co-talker Interference Removal,” IEEE Trans. Speech and Audio Proc., vol. 5, no. 3, 1997.

  19. S. Haykin, Adaptive Filter Theory, Englewood Cliffs, NJ: Prentice-Hall, c1986.

    Google Scholar 

  20. J.C. Principe, N. Euliano, and C. Lefebvre, Neural systems: Fundamentals through Simulations, Wiley, 1999.

  21. P.A. Regalia, Adaptive IIR Filtering in Signal Processing and Control, Marcel Dekker, 1995.

  22. A. Hyvärinen, “Fast and Robust Fixed-Point Algorithms for Independent Component Analysis,” IEEE Transactions on Neural Networks, vol. 10, no. 3, 1999, pp. 626-634.

    Article  Google Scholar 

  23. L. Ljung, “Analysis of Recursive Stochastic Algorithms,” IEEE Transactions on Automatic Control, vol. AC-22, Aug. 1977, pp. 551-575.

    Article  MathSciNet  Google Scholar 

  24. H.J. Kushner and D.S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems, New York: Springer-Verlag.

  25. A. Benveniste, M. Metivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations, Springer-Verlag, 1990.

  26. Y.N. Rao and J.C. Principe, “Robust On-line Principal Component Analysis Based on a Fixed-Point Approach,” Proc. ICASSP, vol. 1, 2002, pp. 981-984.

    Google Scholar 

  27. Y.N. Rao and J.C. Principe, “An RLS Type Algorithm for Generalized Eigendecomposition,” IEEE Workshop on Neural Networks for Signal Processing XI, Sept. 2001, pp. 263-272.

Download references

Author information

Authors and Affiliations

  1. Computational NeuroEngineering Laboratory, Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, 32601

    Yadunandana N. Rao & Jose C. Principe

  2. Wireless Communications Laboratory, Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL, 32601

    Tan F. Wong

Authors
  1. Yadunandana N. Rao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jose C. Principe
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tan F. Wong
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rao, Y.N., Principe, J.C. & Wong, T.F. Fast RLS-Like Algorithm for Generalized Eigendecomposition and its Applications. The Journal of VLSI Signal Processing-Systems for Signal, Image, and Video Technology 37, 333–344 (2004). https://doi.org/10.1023/B:VLSI.0000027495.79266.ad

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:VLSI.0000027495.79266.ad

Search

Navigation