Skip to main content

Signal Processing in a Nonlinear, NonGaussian, and Nonstationary World

  • Conference paper

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 3445))

Abstract

This article discusses three specific issues of particular interest in the study of nonlinear dynamical systems:

  • Bayesian estimation, exemplified by particle filtering;

  • Learning in recurrent neural networks;

  • Correlative learning, exemplified by the ALOPEX algorithm.

By and large, the discussion is of a philosophical nature.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Haykin, S.: Signal processing: Where Physics and Mathematics Meet. IEEE Signal Processing Magazine 18(4), 6–7 (2001) (invited)

    Article  Google Scholar 

  2. Kalman, R.E.: A New Approach to Linear Filtering and Prediction Problems. Transactions of the ASME, Journal of Basic Engineering 82(3), 5–45 (1960)

    Google Scholar 

  3. Robert, C.P., Casella, G.: Monte Carlo Statistical Methods. Springer, Berlin (1999)

    MATH  Google Scholar 

  4. Gordon, N., Salmond, D., Smith, A.F.M.: Novel Approach to Nonlinear/Non-gaussian Bayesian State Estimation. IEE Proceedings-F 140, 107–113 (1993)

    Google Scholar 

  5. Doucet, A., de Freitas, N., Gordon, N.: Sequential Monte Carlo Methods in Practice. Springer, New York (2001)

    MATH  Google Scholar 

  6. Cappé, O., Moulines, E., Rydén, T.: Inference in Hidden Markov Models. Springer, Heidelberg (2005)

    MATH  Google Scholar 

  7. Haykin, S., de Freitas, N. (eds.): In: Special Issue of the Proc. IEEE on Sequential State Estimation (2004)

    Google Scholar 

  8. Haykin, S.: Adaptive Filter Theory, 4th edn. Prentice-Hall, Englewood Cliffs (2002)

    Google Scholar 

  9. Cover, T.: Geometrical and Statistical Properties of Systems of Linear Inequalities with Applications in Pattern Recognition. IEEE Trans. on Electronic Computers EC-14, 326–334 (1965)

    Article  Google Scholar 

  10. Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice-Hall, Englewood Cliffs (1999)

    MATH  Google Scholar 

  11. Maass, W., Natschläger, T., Markram, H.: Real-Time Computing without Stable States: A New Framework for Neural Computation Based on Perturbations. Neural Computation 14, 2531–2560 (2002)

    Article  MATH  Google Scholar 

  12. Jaegar, H., Haas, H.: Harnessing Nonlinearity: Predicting Chaotic Systems and Saving Energy in Wireless Communication. Science 304(5667), 78–80 (2003)

    Article  Google Scholar 

  13. Bengio, Y., Simard, P., Frasconi, P.: Learning Long-Term Dependencies with Gradient Descent is Difficult. IEEE Transactions on Neural Networks 5, 157–166 (1994)

    Article  Google Scholar 

  14. Puskorious, G.V., Feldkamp, L.: Parameter-based Kalman Filter Training: Theory and Implementation. In: Haykin, S. (ed.) Kalman Filtering and Neural Networks, pp. 23–67. John Wiley & Son, Chichester (2001)

    Chapter  Google Scholar 

  15. Feldkamp, L.: Private Communication (October 19, 2004)

    Google Scholar 

  16. Eggermont, J.J.: The Correlative Brain: Theory and Experiment in Neural Interaction. Springer, New York (1990)

    MATH  Google Scholar 

  17. Hebb, D.: Organization of Behavior: A Neuropsychological Theory. Wiley, New York (1949)

    Google Scholar 

  18. Fujita, O.: Trial-and-Error Correlation Learning. IEEE Transactions on Neural Networks 4(4), 720–722 (1993)

    Article  Google Scholar 

  19. Haykin, S., Chen, Z., Becker, S.: Stochastic Correlative Learning Algorithms. IEEE Transactions on Signal Processing 52(8), 2200–2209 (2004)

    Article  MathSciNet  Google Scholar 

  20. Chen, Z.: Stochastic Optimization Approaches for Correlative-based Learning, Ph.D. Thesis, McMaster University, Hamilton, Ontario, Canada, under preparation

    Google Scholar 

  21. Becker, S., Bruce, I.C.: Neural Coding in The Auditory Periphery: Insights From Physiology and Modeling Lead to a Novel Hearing Compensation Algorithm. In: Workshop in Neural Information Coding, Les Houches, France (2002)

    Google Scholar 

  22. Bruce, I.C., Sachs, M.B., Young, E.: An Auditory-Periphery Model of the Effects of Acoustic Trauma on Auditory Nerve Responses. J. of Acoustical Society of America 113(1), 369–388 (2003)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Haykin, S. (2005). Signal Processing in a Nonlinear, NonGaussian, and Nonstationary World. In: Chollet, G., Esposito, A., Faundez-Zanuy, M., Marinaro, M. (eds) Nonlinear Speech Modeling and Applications. NN 2004. Lecture Notes in Computer Science(), vol 3445. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11520153_3

Download citation

  • DOI: https://doi.org/10.1007/11520153_3

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-27441-4

  • Online ISBN: 978-3-540-31886-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics