Abstract
Multi-fidelity (MF) surrogate models have been widely adopted in simulation-based engineering design problems to reduce the computational cost by fusing data with diverse fidelity levels. Most of the MF modeling methods only apply to the problems with hierarchical low-fidelity (LF) models. However, the LF models obtained from different simplification approaches often vary in fidelity levels throughout the design space, namely, the multiple LF models are non-hierarchical. To address this challenge, a MF surrogate modeling method based on variance-weighted sum (VWS-MFS) is developed to flexibly handle multiple non-hierarchical LF data in this work. Firstly, each set of the non-hierarchical LF data is allocated diverse weights according to uncertainties quantified by variances of constructed Kriging models, which enables all the LF data to be fused and contribute to the trend function reflecting the response trend of the true model. Secondly, for more precise scaling factor between HF and LF models and mean square error (MSE) estimation, an improved hierarchical kriging (IHK) model is introduced to construct the MF surrogate model enabling the LF model scaled by a varied scaling factor to capture the characteristics of the HF model. The performance of the proposed VWS-MFS method is compared to three MF surrogate models through several numerical examples and one engineering case. Results show that the proposed method provides more accurate MF surrogate models under the same computational cost. Additionally, the proposed method saved the computational cost by more than 59.61% with the same model accuracy compared to the Kriging model built with HF data for the engineering case.
Similar content being viewed by others
References
Ariyarit A, Sugiura M, Tanabe Y, Kanazaki M (2018) Hybrid surrogate-model-based multi-fidelity efficient global optimization applied to helicopter blade design. Eng Optim 50:1016–1040
Beachy AJ, Clark DL, Bae H, Forster EE (2020) Expected effectiveness based adaptive multi-fidelity modeling for efficient design optimization. In: AIAA Scitech 2020 Forum
Bryson DE, Rumpfkeil MP (2017) All-at-once approach to multifidelity polynomial chaos expansion surrogate modeling. Aerosp Sci Technol 70:121–136
Chatterjee T, Chakraborty S, Chowdhury R (2019) A critical review of surrogate assisted robust design optimization. Arch Comput Methods Eng 26:245–274
Forrester A, Sãbester A, Keane AJ (2007) Multi-fidelity optimization via surrogate modelling. Proc R Soc A. 5:12. https://doi.org/10.1098/rspa.2007.1900
Han Z, Zimmerman R, Grtz S (2012) Alternative cokriging method for variable-fidelity surrogate modeling. AIAA J 50:1205–1210
Han Z, Goertz S (2012) Hierarchical Kriging model for variable-fidelity surrogate modeling. AIAA J 50:1885–1896
Han Z, Xu C, Liang Z, Zhang Y, Song W (2020) Efficient aerodynamic shape optimization using variable-fidelity surrogate models and multilevel computational grids. Chin J Aeronaut 33:31–47
Hao P, Feng S, Zhang K, Li Z, Wang B, Li G (2018) Adaptive gradient-enhanced Kriging model for variable-stiffness composite panels using isogeometric analysis. Struct Multidiscip Optim 58:1–16
Hao P, Feng S, Li Y, Wang B, Chen H (2020) Adaptive infill sampling criterion for multi-fidelity gradient-enhanced kriging model. Struct Multidiscip Optim. https://doi.org/10.1007/s00158-020-02493-8
Howarth RJ (1979) Mining geostatistics. Miner Mag 43(328):563–564. https://doi.org/10.1180/minmag.1979.043.328.34
Hu J, Zhou Q, Jiang P, Shao X, Xie T (2017) An adaptive sampling method for variable-fidelity surrogate models using improved hierarchical kriging. Eng Optim 50:145–163
Jiang C, Qiu H, Yang Z, Chen L, Gao L, Li P (2019) A general failure-pursuing sampling framework for surrogate-based reliability analysis. Reliab Eng Syst Saf 183:47–59
Jiang P, Xie T, Zhou Q, Shao X, Hu J, Cao L (2018) A space mapping method based on Gaussian process model for variable fidelity metamodeling. Simul Model Pract Theory 81:64–84
Jin SS, Kim ST, Park YH (2021) Combining point and distributed strain sensor for complementary data-fusion: a multi-fidelity approach (Accepted Manuscript). Mech Syst Signal Process. https://doi.org/10.1016/j.ymssp.2021.107725
Jones DR (2001) A taxonomy of global optimization methods based on response surfaces. J Glob Optim 21:345–383
Kleijnen J (2008) Response surface methodology for constrained simulation optimization: an overview. Simul Model Pract Theory 16:50–64
Krishna NK, Ganguli R (2021) Multi-fidelity analysis and uncertainty quantification of beam vibration using co-kriging interpolation method. Appl Math Comput. https://doi.org/10.1016/j.amc.2021.125987
Lam R, Allaire DL, Willcox KE (2015) Multifidelity optimization using statistical surrogate modeling for non-hierarchical information sources. In: AIAA/ASCE/AHS/ASC structures, structural dynamics, & materials conference
Li X, Qiu H, Zheng J, Liang G, Shao X (2016) A VF-SLP framework using least squares hybrid scaling for RBDO. Struct Multidiscip Optim 55:1–12
Liu HT, Ong YS, Cai JF, Wang Y (2018) Cope with diverse data structures in multi-fidelity modeling: a Gaussian process method. Eng Appl Artif Intell 67:211–225
Liu Y, Collette M (2014) Improving surrogate-assisted variable fidelity multi-objective optimization using a clustering algorithm. Appl Soft Comput 24:482–493
Lophaven SN, Søndergaard J, Nielsen HB (2002) DACE A Matlab Kriging toolbox
Peng H, Shaojun F, Hao L, Yutian W, Bo W, Bin W (2021) A novel Nested Stochastic Kriging model for response noise quantification and reliability analysis. Comput Methods Appl Mech Eng. https://doi.org/10.1016/j.cma.2021.113941
Priyanka R, Sivapragasam M (2021) Multi-fidelity surrogate model-based airfoil optimization at a transitional low Reynolds number. Sādhanā 46:1–19
Rokita T, Friedmann PP (2018) Multifidelity coKriging for high-dimensional output functions with application to hypersonic airloads computation. AIAA J 56:3060–3070
Shi ML, Lv L, Sun W, Song X (2020) A multi-fidelity surrogate model based on support vector regression. Struct Multidiscip Optim 61:2363–2375
Simpson TW, Mauery TM, Korte JJ, Mistree F (2001) Kriging models for global approximation in simulation-based multidisciplinary design optimization. AIAA J 39:2233–2241
Song X, Sun G, Li G, Gao W, Li Q (2013) Crashworthiness optimization of foam-filled tapered thin-walled structure using multiple surrogate models. Struct Multidiscip Optim 47:221–231
Song X, Lv L, Sun W, Zhang J (2019) A radial basis function-based multi-fidelity surrogate model: exploring correlation between high-fidelity and low-fidelity models. Struct Multidiscip Optim 60:965–981
Sun S, Song B, Wang P, Dong H, Chen X (2020) Shape optimization of underwater wings with a new multi-fidelity bi-level strategy. Struct Multidiscip Optim 61:319–341
Tao S, Apley DW, Chen W, Garbo A, German BJ (2019) Input mapping for model calibration with application to wing aerodynamics. AIAA J 57:1–12
Tripathy M (2010) Power transformer differential protection using neural network principal component analysis and radial basis function neural network. Simul Model Pract Theory 18:600–611
Vafeiadis T, Diamantaras KI, Sarigiannidis G, Chatzisavvas KC (2015) A comparison of machine learning techniques for customer churn prediction. Simul Model Pract Theory 55:1–9
Wang GG, Shan S (2007) Review of metamodeling techniques in support of engineering design optimization. J Mech Des 129:415–426
Wauters J, Couckuyt I, Knudde N, Haene TD, Degroote J (2020) Multi-objective optimization of a wing fence on an unmanned aerial vehicle using surrogate-derived gradients. Struct Multidiscip Optim 61:353–364
Wu Y, Lin Q, Zhou Q, Hu J, Wang S, Peng Y (2021) An adaptive space preselection method for the multi-fidelity global optimization. Aerosp Sci Technol. https://doi.org/10.1016/j.ast.2021.106728
Xia Q, Shi TL (2018) A cascadic multilevel optimization algorithm for the design of composite structures with curvilinear fiber based on Shepard interpolation. Compos Struct 188:209–219
Xiao M, Zhang G, Breitkopf P, Villon P, Pierre V, Zhang W (2018) Extended Co-Kriging interpolation method based on multi-fidelity data. Appl Math Comput 323:120–131
Xing WW, Shah AA, Wang P, Fu S, Kirby R (2021) Residual Gaussian process: a tractable nonparametric Bayesian emulator for multi-fidelity simulations. Appl Math Intell 97:36–56
Yang Y, Wang Y, Liao Q, Pan J, Meng J, Huang H (2021) CNC corner milling parameters optimization based on variable-fidelity metamodel and improved MOPSO regarding energy consumption. Int J Precis Eng Manuf-Green Technol. https://doi.org/10.1007/s40684-021-00338-3
Zhang W, Feng F, Liu W, Yan S, Zhang QJ (2021a) Advanced parallel space-mapping-based multiphysics optimization for high-power microwave filters. In: IEEE transactions on microwave theory and techniques, pp 1–1
Zhang Y, Kim NH, Park C, Haftka RT (2017) Multi-fidelity surrogate based on single linear regression. AIAA J 56:4944–4952
Zhang Y, Dwight RP, Schmelzer M, Gómez J, Hickel S (2021b) Customized data-driven RANS closures for bi-fidelity LES–RANS optimization. J Comput Phys. https://doi.org/10.1016/j.jcp.2021.110153
Zhou Q, Shao X, Jiang P, Zhou H, Cao L, Zhang L (2015) A deterministic robust optimisation method under interval uncertainty based on the reverse model. J Eng Des 26(10–12):416–444
Zhou Q, Shao X, Ping J, Gao Z, Wang C, Shu L (2016) An active learning metamodeling approach by sequentially exploiting difference information from variable-fidelity models. Adv Eng Inform 30:283–297
Zhou Q, Ping J, Shao X, Hu J, Cao L, Li W (2017a) A variable fidelity information fusion method based on radial basis function. Adv Eng Inform 32:26–39
Zhou Q, Wang Y, Choi SK, Ping J, Hu J (2017b) A sequential multi-fidelity metamodeling approach for data regression. Knowl-Based Syst 134:199–212
Zhou Q, Wu J, Xue T, Jin P (2021) A two-stage adaptive multi-fidelity surrogate model-assisted multi-objective genetic algorithm for computationally expensive problems. Eng Comput 37:623–639
Zhu J, Wang Y, Collette M (2014) A multi-objective variable-fidelity optimization method for genetic algorithms. Eng Optim 46:521–542
Funding
This research has been supported by the National Natural Science Foundation of China (NSFC) under Grant Nos. 52175231, 51775203, 51805179, and 51721092, the China Postdoctoral Science Foundation under Grant No. 2020M682396, and the Research Funds of the Maritime Defense Technologies Innovation under Grant YT19201901.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Replication of results
The main step for applying the validation framework has been presented in Sect. 3. To help readers understand better, the toolbox could be downloaded from the website: https://pan.baidu.com/s/1SDshG37cywz1Eu42niq51g by using the code cclq.
Additional information
Responsible Editor: Byeng D Youn
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendix A
Appendix A
The expressions of eight examples used in Subsect. 4.2 are listed.
Example 1
Example 2
Example 3
Example 4
Example 5
Example 6
Example 7
Example 8
Rights and permissions
About this article
Cite this article
Cheng, M., Jiang, P., Hu, J. et al. A multi-fidelity surrogate modeling method based on variance-weighted sum for the fusion of multiple non-hierarchical low-fidelity data. Struct Multidisc Optim 64, 3797–3818 (2021). https://doi.org/10.1007/s00158-021-03055-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00158-021-03055-2