Abstract
Surrogate models are often used as surrogates for computationally intensive simulations. And there are a variety of surrogate models which are widely used in aerospace engineering–related investigation and design. In general, there is an optimal individual surrogate for a certain research object. However, the behavior of an individual surrogate is unknown in advance. Building an ensemble of surrogates by combining different individual surrogates into a weighted-sum formulation is an efficient method to enhance the accuracy and robustness of the surrogate model. Motivated by the previous researches on the ensemble of surrogates, we propose an optimal pointwise weighted ensemble (OPWE) method, wherein the optimal pointwise weight factors are obtained based on the minimization of the local mean square error which is constructed by the global-local error (GLE). By using six well-known mathematical problems and four engineering problems, it is proved that the OPWE proposed in this paper is better than the other ensembles of surrogates in terms of both accuracy and robustness.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Acar E, Rais-Rohani M (2009) Ensemble of metamodels with optimized weight factors. Struct Multidisc Optim 37:279–294. https://doi.org/10.1007/s00158-008-0230-y
Acar E (2010) Various approaches for constructing an ensemble metamodels using local measure. Struct Multidisc Optim 42:879–896. https://doi.org/10.1007/s00158-010-0520-z
Chen L, Qiu H, Jiang C, Cai X, Gao L (2018) Ensemble of surrogates with hybrid method using global and local measures for engineering design. Struct Multidisc Optim 57:1711–1729. https://doi.org/10.1007/s00158-017-1841-y
Ferreira WG, Serpa AL (2016) Ensemble of metamodels: the augmented least squares approach. Struct Multidisc Optim 53:1019–1046. https://doi.org/10.1007/s00158-015-1366-1
Forrester AIJ, Keane AJ (2009) Recent advances in surrogate based optimization. Prog Aerosp Sci 45:50–79
Goel T, Haftka RT, Shyy W, Queipo NV (2007) Ensemble of surrogates. Struct Multidisc Optim 33:199–216. https://doi.org/10.1007/s00158-006-0051-9
Gunn SR (1997) Support vector machines for classification and regression. Technical Report, University of Southampton
Hardy RL (1971) Multiquadric equations of topography and other irregular surfaces. J Geophys Res 76:1950–1915. https://doi.org/10.1029/JB076i008p01905
Imani M, Ghoreishi SF, Braga-Neto UM (2017) Maximum-likelihood adaptive filter for partially observed boolean dynamical systems. IEEE Trans Signal Process 65:357–371
Imani M, Ghoreishi SF, Braga-Neto UM (2018) Bayesian control of large MDPs with unknown dynamics in data-poor environments. Advances in Neural Information Processing Systems: 8146–8156
Imani M, Ghoreishi SF, Allaire D, Braga-Neto UM (2018) MFBO-SSM: Multi-fidelity bayesian optimization for fast inference in state-space models. The Thirty-Third AAAI Conference on Artificial Intelligence (AAAI-19) 33:7858–7865
Jekabsons G (2009) RBF: Radial basis function interpolation for matlab/octave. Riga Technical University, Latvia. version 1.1 ed
Jin R, Chen W, Simpson TW (2001) Comparative studies of metamodeling techniques under multiple modeling criteria. Struct Multidisc Optim 23:1–13. https://doi.org/10.1007/s00158-001-0160-4
Lee SH, Kwak BM (2006) Response surface augmented moment method for efficient reliability analysis. Struct Saf 28:261–272
Lee Y, Choi DH (2014) Pointwise ensemble of meta-models using v nearest points cross-validation. Struct Multidisc Optim 50:383–394. https://doi.org/10.1007/s00158-014-1067-1
Li G, Aute V, Azarm S (2010) An accumulative error based adaptive design of experiments for offline metamodeling. Struct Multidisc Optim 40:137–155. https://doi.org/10.1007/s00158-009-0395-z
Liu H, Xu S, Wang X (2016) Optimal weighted pointwise ensemble of radial basis functions with different basis functions. AIAA J 54:3117–3133. https://doi.org/10.2514/1.J054664
Lophaven SN, Nielsen HB, Sondergaard J (2002) DACE - a matlab kriging toolbox. Tech. Rep. IMM-TR-2002-12. Technical University of Denmark
MacKay DJC (1998) Introduction to Gaussian processes. In: Bishop C M (ed) Neural networks and machine learning, vol 168 of NATO ASI Series, 1998. https://doi.org/10.1007/978-0-387-21681-2-8. Springer, Berlin, pp 135–165
Messac A, Mullur AA (2008) A computationally efficient metamodeling approach for expensive multiobjective optimization. Optim Eng 9:37–67
Meng Z, Zhang D, Li G, Yu B (2019) An importance learning method for non-probabilistic reliability analysis and optimization. Struct Multidisc Optim 59:1255–1271. https://doi.org/10.1007/s00158-018-2128-7
Myers RH, Montgomery DC (2002) Response surface methodology: process and product optimization using designed experiments. Wiley, New York
Queipo NV, Haftka RT, Shyy W, Goel T, Vaidyanathan R, Tucker PK (2005) Surrogate-based analysis and optimization. Prog Aerosp Sci 41:1–28
Rasmussen CE, Williams CK (2006) Gaussian processes for machine learning. The MIT Press
Sacks J, Welch WJ, Mitchell TJ, Wynn HP (1989) Design and analysis of computer experiments. Stat Sci 4(4):409–435. https://doi.org/10.1214/ss/1177012413
Simpson TW, Peplinski JD, Koch PN, Allen JK (2001) Metamodels for computer-based engineering design: survey and recommendations. Eng Comput 17:129–150. https://doi.org/10.1007/PL00007198
Smith M (1993) Neural networks for statistical modeling. Von Nostrand Reinhold, New York
Viana FAC, Haftka RT, Steffen V (2009) Multiple surrogates: how cross-validation errors help us to obtain the best predictor. Struct Multidisc Optim 39:439–457. https://doi.org/10.1007/s00158-008-0338-0
Viana FAC (2011) SURROGATES toolbox user’s guide version 3.0. http://sites.google.com/site/felipeacviana/surrogate-stoolbox
Wang GG, Shan S (2007) Review of metamodeling techniques in support of engineering design optimization. ASME J Mech Des 129(4):370–380
Yin H, Fang H, Wen G, Gutowski M, Xiao Y (2018) On the ensemble of metamodels with multiple regional optimized weight factors. Struct Multidisc Optim 58:245–263. https://doi.org/10.1007/s00158-017-1891-1
Zhang X, Wang Z, Zhou L, Liu Z (2016) Multidisciplinary design optimization on conceptual design of aero-engine. International Journal of Turbo and Jet-Engine 33(2):195–208. https://doi.org/10.1515/tjj-2015-0024
Zhou XJ, Ma YZ, Li XF (2011) Ensemble of surrogates with recursive arithmetic average. Struct Multidisc Optim 44:651–671. https://doi.org/10.1007/s00158-011-0655-6
Funding
This study received financial support from the National Natural Science Foundation of China (Nos. 51876176 and 51576163) and MIIT of China.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interests
The authors declare that they have no conflict of interest.
Additional information
Responsible Editor: Shapour Azarm
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Replication of results
The method proposed in this paper is implemented in the surrogates module of SURROGATES (2011), a MATLAB-based toolbox for multidimensional function approximation and optimization methods. The results presented in this paper can thus be reproduced easily.
Rights and permissions
About this article
Cite this article
Ye, Y., Wang, Z. & Zhang, X. An optimal pointwise weighted ensemble of surrogates based on minimization of local mean square error. Struct Multidisc Optim 62, 529–542 (2020). https://doi.org/10.1007/s00158-020-02508-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-020-02508-4