Skip to main content
SpringerLink
Log in

Ordinary differential equations solution in kernel space

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

This paper presents a new method based on the use of an optimization approach along with kernel least mean square (KLMS) algorithm for solving ordinary differential equations (ODEs). The new approach in comparison with the other existing methods (such as numerical methods and the methods that are based on neural networks) has more advantages such as simple implementation, fast convergence, and also little error. In this paper, we use the ability of KLMS in prediction by applying an optimization method to predict the solution of ODE. The basic idea is that first a trial solution of the ODE is written by using the KLMS structure, and then by defining an error function and minimizing it via an optimization algorithm (in this paper, we used the quasi-Newton BFGS method), the parameters of KLMS are adjusted such that the trial solution satisfies the DE. After the optimization step, the achieved optimal parameters of the KLMS model are replaced in the trial solution. The accuracy of the method is illustrated by solving several problems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Vapnik V (1995) The nature of statistical learning theory. Springer, New York

    MATH  Google Scholar 

  2. Girosi F, Jones M, Poggio T (1995) Regularization theory and neural networks architectures. Neural Comput 7(2):219–269

    Article  Google Scholar 

  3. Scholkopf B, Smola A, Muller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 10:1299–1319

    Article  Google Scholar 

  4. Bach FR, Jordan MI (2002) Kernel independent component analysis. J Mach Learn Res 3:1–48

    MathSciNet  Google Scholar 

  5. Pokharel P, Liu W, Principe JC (2007) Kernel lms. In: Proceedings of international conference on acoustics, speech and signal processing

  6. Liu W, Pokharel P, Principe JC (2008) The kernel least mean square algorithm. IEEE Trans Signal Process 56:543–554

    Article  MathSciNet  Google Scholar 

  7. Gunduz A, Kwon J-P, Sanchez JC, Principe JC (2009) Decoding hand trajectories from ECoG recordings via kernel least-mean-square algorithm. In: Proceedings of the 4th international IEEE EMBS conference on neural engineering antalya, Turkey, April 29–May 2

  8. Lagaris IE, Likas A, Fotiadis DI (1998) Artificial neural network for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000

    Article  Google Scholar 

  9. Hornik K (1989) Multilayer feedforward networks are universal approximators. Neural Netw 2:359–366

    Article  Google Scholar 

  10. Smaoui N, Al-Enezi S (2004) Modeling the dynamics of nonlinear partial differential equations using neural networks. J Comput Appl Math 170:27–58

    Article  MathSciNet  MATH  Google Scholar 

  11. Brause R (2003) Adaptive modeling of biochemical pathways. In: Proceedings of the 15th IEEE international conference on tools with artificial intelligence (ICTAI’03)

  12. Hea S, Reif K, Unbehauen R (2000) Multilayer neural networks for solving a class of partial differential equations. Neural Netw 13:385–396

    Article  Google Scholar 

  13. Manevitz L, Bitar A, Givoli D (2005) Neural network time series forecasting of finite-element mesh adaptation. Neurocomputing 63:447–463

    Article  Google Scholar 

  14. Leephakpreeda T (2002) Novel determination of differential-equation solutions: universal approximation method. J Comput Appl Math 146:443–457

    Article  MathSciNet  MATH  Google Scholar 

  15. Malek A, Shekari Beidokhti R (2006) Numerical solution for high order differential equations using a hybrid neural network—optimization method. Appl Math Comput 183:260–271

    Article  MathSciNet  MATH  Google Scholar 

  16. Mai-Duy N, Tran-Cong T (2001) Numerical solution of differential equations using multi quadric radial basis function networks. Neural Netw 14:185–199

    Article  Google Scholar 

  17. Jianyu L, Siwei L, Yingjian Q, Yaping H (2003) Numerical solution of elliptic partial differential equation using radial basis function neural networks. Neural Netw 16:729–734

    Article  Google Scholar 

  18. Parisi DR, Mariani MC, Laborde MA (2003) Solving differential equations with unsupervised neural networks. Chem Eng Process 42:715–721

    Article  Google Scholar 

  19. Luenberger DG (1984) Linear and nonlinear programming, 2nd edn. Addison-wesley, Boston

  20. Effati S, Pakdaman M (2010) Artificial neural network approach for solving fuzzy differential equations. Inf Sci 180:1434–1457

    Article  MathSciNet  MATH  Google Scholar 

  21. Sadoghi Yazdi H, Pourreza R (2010) Unsupervised adaptive neural-fuzzy inference system for solving differential equations. Appl Soft Comput 10:267–275

    Article  Google Scholar 

  22. Sadoghi Yazdi H, Pakdaman M, Modaghegh H (2011) Unsupervised kernel least mean square algorithm for solving ordinary differential equations. Neuromputing 74:2062–2071

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran

    Hadi Sadoghi Yazdi & Hamed Modaghegh

  2. Sama Technical and Vocational Training College, Islamic Azad University, Mashhad Branch, Mashhad, Iran

    Morteza Pakdaman

Authors
  1. Hadi Sadoghi Yazdi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hamed Modaghegh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Morteza Pakdaman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Morteza Pakdaman.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sadoghi Yazdi, H., Modaghegh, H. & Pakdaman, M. Ordinary differential equations solution in kernel space. Neural Comput & Applic 21 (Suppl 1), 79–85 (2012). https://doi.org/10.1007/s00521-011-0621-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-011-0621-7

Keywords

Search

Navigation