Abstract
The space mapping technique is intended for optimization of engineering models which involve very expensive function evaluations. It may be considered a preprocessing method which often provides a very efficient initial phase of an optimization procedure. However, the ultimate rate of convergence may be poor, or the method may even fail to converge to a stationary point.
We consider a convex combination of the space mapping technique with a classical optimization technique. The function to be optimized has the form H ○ f where H : Rm → R is convex and f : Rn → Rm is smooth. Experience indicates that the combined method maintains the initial efficiency of the space mapping technique. We prove that the global convergence property of the classical technique is also maintained: The combined method provides convergence to the set of stationary points of H ○ f.
Similar content being viewed by others
References
M. H. Bakr, J. W. Bandler, K. Madsen, and J. Søndergaard, “Review of the space mapping approach to engineering optimization and modelling,” Optimization and Engineering vol. 1, pp. 241–276, 2000.
M. H. Bakr, J. W. Bandler, K. Madsen, and J. Søndergaard, “An introduction to the space mapping technique,” Optimization and Engineering vol. 2, pp. 369–384, 2001.
J. W. Bandler, R. M. Biernacki, S. H. Chen, P. A. Grobelny, and R. H. Hemmers, “Space mapping technique for electromagnetic optimization,” IEEE Trans. Microwave Theory Tech. vol. 42, pp. 2536–2544, 1994.
C. G. Broyden, “A class of methods for solving non-linear simultaneous equations,” Math. Comp. vol. 19, pp. 577–593, 1965.
F. H. Clarke, “Generalized gradients and applications,” Trans. Am. Maths. Society vol. 205, pp. 247–262, 1975.
F. H. Clarke, Optimization and Nonsmooth Analysis, Canadian Mathematical Society Series of Monographs and Advanced Texts, John Wiley & Sons, 1983, pp. 1–308.
R. Fletcher, “A model algorithm for composite nondifferentiable optimization problems,” in D. C. Sorensen, R. J.-B. Wets, eds., Nondifferentiable and Variational Techniques in Optimization, Mathematical Programming Study, vol. 17, North-Holland: Amsterdam, 1982.
J. Hald and K. Madsen, “Combined LP and quasi-newton methods for non-linear L1 optimization,” SIAM J. Num. Anal. vol. 22, pp. 369–384 1985.
K. Madsen, “An algorithm for minimax solution of overdetermined systems of non-linear equations,” J. Inst. Math. Appl. vol. 16, pp. 321–328, 1975.
K. Madsen, “Minimization of non-linear approximation functions,” Dr. Techn. Thesis, Institute for Numerical Analysis, Technical University of Denmark, 1985, pp. 1–141.
F. Ø. Pedersen, “Advances on the space mapping optimization method,” Master Thesis, IMM-THESIS-2001-35, Informatics and Mathematical Modelling, Technical University of Denmark, 2001.
L. N. Vicente, “Space mapping: Models, sensitivities, and trust-regions methods,” to appear in Optimization and Engineering, 2003.
R. S. Womersley and R. Fletcher, “An algorithm for composite nonsmooth optimization problems,” J. Opt. Theo. Applns. vol. 48, pp. 493–523, 1986.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Madsen, K., Søndergaard, J. Convergence of Hybrid Space Mapping Algorithms. Optimization and Engineering 5, 145–156 (2004). https://doi.org/10.1023/B:OPTE.0000033372.34626.49
Issue Date:
DOI: https://doi.org/10.1023/B:OPTE.0000033372.34626.49