Abstract
Metaheuristics are stochastic optimization algorithms that mimic natural processes to find optimal solutions to complex problems. The success of metaheuristics largely depends on the ability to effectively explore and exploit the search space. Memory mechanisms have been introduced in several popular metaheuristic algorithms to enhance their performance. This chapter explores the significance of memory in metaheuristic algorithms and provides insights from well-known algorithms. The chapter begins by introducing the concept of memory, and its role in metaheuristic algorithms. The key factors influencing the effectiveness of memory mechanisms are discussed, such as the size of the memory, the information stored in memory, and the rate of information decay. A comprehensive analysis of how memory mechanisms are incorporated into popular metaheuristic algorithms is presented, and concludes by highlighting the importance of memory in metaheuristic performance and providing future research directions for improving memory mechanisms. The key takeaways are that memory mechanisms can significantly enhance the performance of metaheuristics by enabling them to explore and exploit the search space effectively and efficiently, and that the choice of memory mechanism should be tailored to the problem domain and the characteristics of the search space.
This is a preview of subscription content, log in via an institution to check access.
References
Acan A, Ünveren A (2014) A two-stage memory powered Great Deluge algorithm for global optimization. Soft Comput 19(9):2565–2585. https://doi.org/10.1007/s00500-014-1423-5
Ashtari P, Karami R, Farahmand-Tabar S (2021) Optimum geometrical pattern and design of real-size diagrid structures using accelerated fuzzy-genetic algorithm with bilinear membership function. Appl Soft Comput 110:107646. https://doi.org/10.1016/j.asoc.2021.107646
Askarzadeh A (2018) A memory-based genetic algorithm for optimization of power generation in a microgrid. IEEE Trans Sustain Energy 9(3):1081–1089. https://doi.org/10.1109/tste.2017.2765483
Bednarczuk EM, Jezierska A, Rutkowski KE (2018) Proximal primal–dual best approximation algorithm with memory. Comput Optim Appl 71(3):767–794. https://doi.org/10.1007/s10589-018-0031-1
Bentsen H, Hoff A, Magnus HL (2022) Exponential extrapolation memory for tabu search. EURO J Comput Optimiz 10:100028. https://doi.org/10.1016/j.ejco.2022.100028
Bijari K, Zare H, Veisi H et al (2016) Memory-enriched big bang–big crunch optimization algorithm for data clustering. Neural Comput Appl 29(6):111–121. https://doi.org/10.1007/s00521-016-2528-9
Braik M, Al-Zoubi H, Ryalat M et al (2022) Memory based hybrid crow search algorithm for solving numerical and constrained global optimization problems. Artif Intell Rev 56(1):27–99. https://doi.org/10.1007/s10462-022-10164-x
Carrano EG, Moreira LAC, Takahashi R (2011) A new memory based variable-length encoding genetic algorithm for multiobjective optimization. Lect Notes Comput Sci 6576:328–342. https://doi.org/10.1007/978-3-642-19893-9_23
Chai R (2021) Otsu’s image segmentation algorithm with memory-based fruit fly optimization algorithm. Complexity 2021:1–11. https://doi.org/10.1155/2021/5564690
Chourasia U, Silakari S (2021) Adaptive neuro fuzzy interference and PNN memory based Grey Wolf optimization algorithm for optimal load balancing. Wirel Pers Commun 119(4):3293–3318. https://doi.org/10.1007/s11277-021-08400-8
Cui C, Feng T, Yang N et al (2015) Memory based differential evolution algorithms for dynamic constrained optimization problems. In: 2015 11th international conference on computational intelligence and security (CIS). https://doi.org/10.1109/cis.2015.16
Debnath S, Kurmvanshi R, Arif W (2022) Performance analysis of hybrid memory based dragonfly algorithm in engineering problems. Stud Comput Intell 89–106. https://doi.org/10.1007/978-3-031-09835-2_5
Duan Q, Mao M, Duan P et al (2016) An improved artificial fish swarm algorithm optimized by particle swarm optimization algorithm with extended memory. Kybernetes 45(2):210–222. https://doi.org/10.1108/k-09-2014-0198
Etaati B, Ghorrati Z, Mehdi EM (2022) A full-featured cooperative coevolutionary memory-based artificial immune system for dynamic optimization. Appl Soft Comput 117:108389. https://doi.org/10.1016/j.asoc.2021.108389
Farahmand-Tabar S, Ashtari P (2020) Simultaneous size and topology optimization of 3D outrigger-braced tall buildings with inclined belt truss using genetic algorithm. Struct Des Tall Special Build 29(13):e1776. https://doi.org/10.1002/tal.1776
Farahmand-Tabar S, Babaei M (2023) Memory-assisted adaptive multi-verse optimizer and its application in structural shape and size optimization. Soft Comput. https://doi.org/10.1007/s00500-023-08349-9
Farahmand-Tabar S, Barghian M (2020a) Formulating the optimum parameters of modified hanger system in the cable-arch bridge to restrain force fluctuation and overstressing problems. J Braz Soc Mech Sci Eng 42:453. https://doi.org/10.1007/s40430-020-02513-0
Farahmand-Tabar S, Barghian M (2020b) Response control of cable-stayed arch bridge using modified hanger system. J Vib Control 26(23–24):2316–2328. https://doi.org/10.1177/1077546320921635
Farahmand-Tabar S, Barghian M (2021) Seismic assessment of a cable-stayed arch bridge under three-component orthotropic earthquake excitation. Adv Struct Eng 24(2):227–242. https://doi.org/10.1177/1369433220948756
Farahmand-Tabar S, Barghian M (2023) Seismic evaluation of the bridge with a hybrid system of cable and arch: simultaneous effect of seismic hazard probabilities and vertical excitations. Mech Based Des Struct Mach. https://doi.org/10.1080/15397734.2023.2172029
Farahmand-Tabar S, Barghian M, Vahabzadeh M (2019) Investigation of the progressive collapse in a suspension bridge under the explosive load. Int J Steel Struct 19(6):2039–2050. https://doi.org/10.1007/s13296-019-00263-x
Gandomi AH, Abualigah L (eds) (2022) Evolutionary process for engineering optimization. MDPI. https://doi.org/10.3390/books978-3-0365-4772-5
Gandomi AH, Alavi AH (2012) Krill herd: a new bio-inspired optimization algorithm. Commun Nonlinear Sci Numer Simul 12:4831–4845
Gong X, Rong Z, Gao T et al (2019) An improved ant colony optimization algorithm based on fractional order memory for traveling salesman problems. In: 2019 IEEE symposium series on computational intelligence (SSCI). https://doi.org/10.1109/ssci44817.2019.9003009
Guo H, Cheng T, Chen X et al (2011) Visual feedback and behavior memory based ant colony optimization algorithm. J Softw 22(9):1994–2005. https://doi.org/10.3724/sp.j.1001.2011.03949
Gupta S, Deep K (2020) A memory-based Grey Wolf Optimizer for global optimization tasks. Appl Soft Comput 93:106367. https://doi.org/10.1016/j.asoc.2020.106367
Gupta S, Deep K, Engelbrecht AP (2020) A memory guided sine cosine algorithm for global optimization. Eng Appl Artif Intell 93:103718. https://doi.org/10.1016/j.engappai.2020.103718
Han X, Liu Q, Wang L et al (2018) An improved fruit fly optimization algorithm based on knowledge memory. Int J Comput Appl 42(6):558–568. https://doi.org/10.1080/1206212x.2018.1479349
Jan BA, Nordin M (2017) Mutation and memory mechanism for improving Glowworm Swarm Optimization algorithm. In: 2017 IEEE 7th annual computing and communication workshop and conference (CCWC). https://doi.org/10.1109/ccwc.2017.7868403
Ji Z, Tian T, He S et al (2012) A memory binary particle swarm optimization. In: 2012 IEEE congress on evolutionary computation. https://doi.org/10.1109/cec.2012.6256150
Kaedi M, Ghasem-Aghaee N, Wook AC (2013) Holographic memory-based Bayesian optimization algorithm (HM-BOA) in dynamic environments. Science China Inf Sci 56(9):1–17. https://doi.org/10.1007/s11432-013-4829-2
Kamyab S, Eftekhari M (2013) Using a self-adaptive neighborhood scheme with crowding replacement memory in genetic algorithm for multimodal optimization. Swarm Evolut Comput 12:1–17. https://doi.org/10.1016/j.swevo.2013.05.002
Karimzadeh Parizi M, Keynia F, Khatibi Bardsiri A (2021) OWMA: an improved self-regulatory woodpecker mating algorithm using opposition-based learning and allocation of local memory for solving optimization problems. J Intell Fuzzy Syst 40(1):919–946. https://doi.org/10.3233/jifs-201075
Kaveh A (2021) Advances in metaheuristic algorithms for optimal design of structures. Springer. https://doi.org/10.1007/978-3-030-59392-6
Kaveh A, Dadras A (2017) A novel meta-heuristic optimization algorithm: thermal exchange optimization. Adv Eng Softw 110:69–84
Korosec P, Å ilc J, Vajtersic M et al (2011) A shared-memory ACO-based algorithm for numerical optimization. In: 2011 IEEE international symposium on parallel and distributed processing workshops and Phd forum. https://doi.org/10.1109/ipdps.2011.176
Li W (2018) Improving particle swarm optimization based on neighborhood and historical memory for training multi-layer perceptron. Information 9(1):16–16. https://doi.org/10.3390/info9010016
Li K, Tian H (2019) Adaptive differential evolution with evolution memory for multiobjective optimization. IEEE Access 7:866–876. https://doi.org/10.1109/access.2018.2885947
Li J, Fan C, Yi L et al (2018) Multi-objective optimization algorithm based on kinetic-molecular theory with memory global optimization. In: 2018 13th world congress on intelligent control and automation (WCICA). https://doi.org/10.1109/wcica.2018.8630566
Li S, Wang Y, Yue W (2020) A regional local search and memory based evolutionary algorithm for dynamic multi-objective optimization. In: 2020 39th Chinese control conference (CCC). https://doi.org/10.23919/ccc50068.2020.9189176
Liu M, Zeng W (2014) Memory enhanced dynamic multi-objective evolutionary algorithm based on decomposition. J Softw 24(7):1571–1588. https://doi.org/10.3724/sp.j.1001.2013.04311
Liu R, Jiao L, Li Y et al (2010) An immune memory clonal algorithm for numerical and combinatorial optimization. Front Comput Sci China 4(4):536–559. https://doi.org/10.1007/s11704-010-0573-6
Luo W, Sun J, Bu C et al (2016) Species-based Particle Swarm Optimizer enhanced by memory for dynamic optimization. Appl Soft Comput 47:130–140. https://doi.org/10.1016/j.asoc.2016.05.032
Mavrovouniotis M, Yang S (2012) Ant colony optimization with memory-based immigrants for the dynamic vehicle routing problem. In: 2012 IEEE congress on evolutionary computation. https://doi.org/10.1109/cec.2012.6252885
Mirjalili S, Gandomi AH (eds) (2023) Comprehensive metaheuristics: algorithms and applications. Academic, London
Moradi M, Nejatian S, Parvin H et al (2018) CMCABC: clustering and memory-based chaotic artificial bee colony dynamic optimization algorithm. Int J Inf Technol Decis Mak 17(4):1007–1046. https://doi.org/10.1142/s0219622018500153
Nakano H, Kojima M, Miyauchi A (2015) An artificial bee colony algorithm with a memory scheme for dynamic optimization problems. In: 2015 IEEE congress on evolutionary computation (CEC). https://doi.org/10.1109/cec.2015.7257217
Park S, Ko K, Park J et al (2011) Game model-based co-evolutionary algorithm with non-dominated memory and Euclidean distance selection mechanisms for multi-objective optimization. Int J Control Autom Syst 9(5):924–932. https://doi.org/10.1007/s12555-011-0513-8
Peng L, Zhu Q, Lv S et al (2020) Effective long short-term memory with fruit fly optimization algorithm for time series forecasting. Soft Comput 24(19):15059–15079. https://doi.org/10.1007/s00500-020-04855-2
Prasad Parouha R, Nath Das K (2016a) A memory based differential evolution algorithm for unconstrained optimization. Appl Soft Comput 38:501–517. https://doi.org/10.1016/j.asoc.2015.10.022
Prasad Parouha R, Nath Das K (2016b) A robust memory based hybrid differential evolution for continuous optimization problem. Knowl-Based Syst 103:118–131. https://doi.org/10.1016/j.knosys.2016.04.004
Rahmi SS, Topcuoglu H (2016) A memory-based NSGA-II algorithm for dynamic multi-objective optimization problems. Appl Evol Comput 296–310. https://doi.org/10.1007/978-3-319-31153-1_20
Rakshit P (2020) Memory based self-adaptive sampling for noisy multi-objective optimization. Inf Sci 511:243–264. https://doi.org/10.1016/j.ins.2019.09.060
Ranjini KSS, Murugan S (2017) Memory based Hybrid Dragonfly Algorithm for numerical optimization problems. Expert Syst Appl 83:63–78. https://doi.org/10.1016/j.eswa.2017.04.033
Riaz F, Shafi I, Jabbar S et al (2015) A novel white space optimization scheme using memory enabled genetic algorithm in cognitive vehicular communication. Wirel Pers Commun 93(2):287–309. https://doi.org/10.1007/s11277-015-3117-4
Rocha I, Parente E, Melo A (2014) A hybrid shared/distributed memory parallel genetic algorithm for optimization of laminate composites. Compos Struct 107:288–297. https://doi.org/10.1016/j.compstruct.2013.07.049
Salam Al Daweri M, Abdullah S, Zainol Ariffin K (2020) A migration-based cuttlefish algorithm with short-term memory for optimization problems. IEEE Access 8:70270–70292. https://doi.org/10.1109/access.2020.2986509
Simon D (2008) Biogeography-based optimization. IEEE Trans Evol Comput 12(6):702–713
Tang D, Cai Y, Zhao J et al (2014) A quantum-behaved particle swarm optimization with memetic algorithm and memory for continuous non-linear large scale problems. Inf Sci 289:162–189. https://doi.org/10.1016/j.ins.2014.08.030
Vasilyev I, Ushakov A (2017) A shared memory parallel heuristic algorithm for the large-scale p-median problem. Springer Proc Math Stat 217:295–302. https://doi.org/10.1007/978-3-319-67308-0_30
Wang D, Zhang WH, Jiang JS (2002) Combined shape and sizing optimization of truss structures. Comput Mech 29:307–312. https://doi.org/10.1007/s00466-002-0343-x
Wei B, Zhang W, Xia X et al (2019) Efficient feature selection algorithm based on particle swarm optimization with learning memory. IEEE Access 7:166066–166078. https://doi.org/10.1109/access.2019.2953298
Woo GZ (2012) Effects of initial memory and identical harmony in global optimization using harmony search algorithm. Appl Math Comput 218(22):11337–11343. https://doi.org/10.1016/j.amc.2012.04.070
Xia Z, Liu F, Gong M et al (2011) Memory based Lamarckian evolutionary algorithm for job shop scheduling problem. J Softw 21(12):3082–3093. https://doi.org/10.3724/sp.j.1001.2010.03687
Xiao H, Guo J, Shi B et al (2023) A twinning memory bare-bones particle swarm optimization algorithm for no-linear functions. IEEE Access 11:25768–25785. https://doi.org/10.1109/access.2022.3222530
Yang XS et al (eds) (2013) Swarm intelligence and bio-inspired computation: theory and applications. Elsevier. https://doi.org/10.1016/C2012-0-02754-8
Yin P, Chen P, Wei Y et al (2020) Cyber firefly algorithm based on adaptive memory programming for global optimization. Appl Sci 10(24):8961. https://doi.org/10.3390/app10248961
Yu Z, Wang A (2010) Global convergence of a nonmonotone trust region algorithm with memory for unconstrained optimization. J Math Model Algorithms 10(2):109–118. https://doi.org/10.1007/s10852-010-9143-z
Zong X, Liu J, Ye Z et al (2022) Whale optimization algorithm based on Levy flight and memory for static smooth path planning. Int J Modern Phys C 33(10). https://doi.org/10.1142/s0129183122501388
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Section Editor information
Rights and permissions
Copyright information
© 2023 Springer Nature Singapore Pte Ltd.
About this entry
Cite this entry
Farahmand-Tabar, S. (2023). Memory-Driven Metaheuristics: Improving Optimization Performance. In: Kulkarni, A.J., Gandomi, A.H. (eds) Handbook of Formal Optimization. Springer, Singapore. https://doi.org/10.1007/978-981-19-8851-6_38-1
Download citation
DOI: https://doi.org/10.1007/978-981-19-8851-6_38-1
Received:
Accepted:
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-8851-6
Online ISBN: 978-981-19-8851-6
eBook Packages: Springer Reference Intelligent Technologies and RoboticsReference Module Computer Science and Engineering