Thermal processing optimization through a modified adaptive random search
Introduction
A large number of real-life decision making problems arising in sciences, engineering and economics, can be formulated as a problem of optimization of various real-valued functions of real-valued parameters (objective function) with specific constraints, where the global optimum corresponds to the best solution to the initial problem (Horst and Pardalos, 1995). Such optimization problems may be nonlinear with many local solutions; moreover, a single computation of objective function with constraints, may take significant CPU-time. As an example, we can mention the dynamical optimization problem where single computations of optimization problems need to be integrated via a system of differential–algebraic equations over the whole time interval (Schlegel et al., 2005, Banga et al., 2005). Therefore, effective global optimization techniques with minimal optimization computations to reach global optimum location are needed.
Random search techniques are widely used to solve global optimization problems for various reasons. Firstly, random search techniques are easily used in practical implementations and they are independent of a priori information about the optimization problem to be solved. Secondly, the optimization problem could be considered as a “black-box” problem where no closed-form formulation and gradient information of the given problems are available.
Various classes of random search methods have been proposed over the past decades:
- •
Random Line Search (Rastrigin and Rubinstein, 1969, Zhensheng Yua and Dingguo Pu, 2008).
- •
Multiple random starts with local search utilization (multi-start methods) (Zhigljavsky, 1991, Zhigljavsky and Zilinskas, 2008).
- •
Controlled Random Search (Price, 1977, Banga and Casares, 1987, Tvrdík et al., 2007, Ali and Törn, 2004).
- •
Simulated annealing (Kirkpatrick et al., 1983).
- •
Tabu search (Glover, 1989).
- •
Ant colony optimizations (Dorigo, 1992, Dorigo and Gambardella, 1997, Dorigo and Stűtzle, 2004, Socha and Dorigo, 2008).
- •
Genetic algorithms (Rechenberg, 1973, Holland, 1975, Andersson, 2000, Neelesh et al., 2007).
Let the global optimization problem be formulated as follows, in which a continuous objective function of decision variables is to be minimized over a set of candidate decision variables:where:
- •
—is a non-empty set of feasible decisions (a proper subset of (Rn),
- •
—is a real n—vector decision variable, and
- •
—is a continuous objective function.
The general algorithm scheme of random search (Zhigljavsky, 1991, Tikhomirov et al., 2007) could be presented as follows:
General algorithm scheme of random search:
- 1.
Set s = 1, xs−1 = xo, where xo is the initial point of the searching process (xo X) and s is the iteration number.
- 2.
Generate a new vector x′ X from some probability distribution .
- 3.
If then xs = x′, else xs = xs−1.
- 4.
Set s = s + 1.
- 5.
If some stop condition is satisfied, then finish the search process, or else go to step 2.
Many modifications of random search can be constructed from the general algorithm scheme, mainly, by defining a concrete probability distribution Ps(xs − 1,·) for each iteration number s. In the case where uniform distribution is chosen as the probability distribution Ps(xs − 1,·) for all of the iteration numbers, the pure random search algorithm will be obtained (Zhigljavsky, 1991). It is well-known that the probability of finding a global solution of problem (1) in the case of pure random search utilization is equal to 1, but it takes too many computations of problem (1), therefore, a lot of modifications of the general algorithm have been proposed to significantly reduce the computations of problem (1).
The global stochastic optimization algorithm to be improved in this work belongs to several specific classes of random search algorithms (Zhigljavsky, 1991, Zhigljavsky and Zilinskas, 2008), namely adaptive random search algorithm (Sushkov, 1969). The term “adaptation” in this case consists of such modifications in the probability distribution Ps(xs − 1,·), which throughout the whole search process, act as minimum computations of problem (1), locating global solutions. As an example of such algorithms we can mention here the Integrated Control Random Search algorithm (ICRS) (Banga and Casares, 1987). This method has been successfully utilized for a wide set of the practical optimization problems, especially for dynamical optimization of bioprocesses (Banga and Seider, 1996, Banga et al., 2005, García et al., 2005). The ICRS uses the Gaussian probability distribution Ps(xs − 1,·) to generate new vectors , where adaptation consists of reducing and increasing the standard deviation of the Gaussian probability distribution around its mean.
The proposed modification here is based on logistic function implementation, in order to improve adaptive characteristics of random search. The logistic equation was first published by Verhulst (1845) as a model of population growth. The continuous version of a logistic model is the following differential equation:where μ is the Malthusian parameter (rate of maximum population growth). The solution of Eq. (2) could be written as:where α and μ are the parameters of logistic curve. The function of x(t) is also called the sigmoid function (Krose, 1993).
Logistic functions or logistic curves find their application in a wide range of scientific fields. Some of the well-known applications are as follows:
- •
Artificial neural networks (ANN) (Krose, 1993), where sigmoid functions are often used for the ANN learning process.
- •
Statistics, where logistic functions are used as regression models, namely the logistic regression models (Hosmer and Lemeshow, 2000) and as a cumulative distribution function (Marin and Buckius, 1998).
- •
Sociology and Ecology: as models of population growth (Chapman, 1931; Mulligan and Gordon, 2006, Molles, 2004).
- •
Medicine: for simulation of tumor growths (Moate et al., 2004).
It should be noted that there is a class of global stochastic optimization methods – chaos optimization where logistic equation or, rather, logistic maps (May, 1976) were successfully applied (Yang et al., 2007, Li and Jiang, 1998). Logistic maps are modifications of the continuous logistic Eq. (2) and the well-known logistic map can be written as:where μ is the control of logistic map. The algorithms of chaos optimization use a logistic map as a pseudo-random vector xj Χ value generator. Optimization problem (1) needs to be calculated with respect to the generated vectors value and the best point (or points) should be chosen. The best point is assumed to be close to the global solution; therefore, the current best point is used as the center for the next decision’s vector generation. This process could be repeated until some stop condition of the search process is satisfied. It is known that for some control values μ, the values xn + 1 behave chaotically (May, 1976, Devaney, 1992, Yang et al., 2007) and so this optimization technique was called “chaos optimization”.
In this work, the logistic curve is used differently. It reduces the same sub-domain I Χ, which is assumed to contain the global solution of problem (1), and iteration number of the random search algorithm or number of problem (1) computations. In other words, the logistic curve is used to reduce the deviation generated by the random search algorithm with values of xj Χ, j 1:s, around the mean, and the mean is assumed to be the current best solution 1:s, of the search process.
Optimization of thermal processing of canned foods was solved by the proposed modification in order to show its advantage over the basic random search algorithm. Thermal processing is an important method of food preservation in the manufacture of shelf stable canned foods, and has been the cornerstone of the food processing industry for more than a century (Teixeira, 1992). The basic function of a thermal process is to inactivate bacterial spores of public health significance as well as food spoilage microorganisms in sealed containers of food, using heat treatments at temperatures well above the ambient boiling point of water in pressurized steam retorts (autoclaves). Excessive heat treatments should be avoided because they are detrimental to food quality, and underutilize plant capacity (Simpson et al., 2003).
Thermal process calculations, in which process times at specified retort temperatures are calculated in order to achieve safe levels of microbial inactivation (lethality), must be carried out carefully to assure public health safety and minimum probability of spoilage. Therefore, the accuracy of the methods used for this purpose is of importance to food science and engineering professionals working in this field (Holdsworth and Simpson, 2007). Considerable work has been reported in the literature, showing that variable retort temperatures (VRT) can be used to marginally improve the quality of canned food and significantly reduce processing times in comparison to traditional constant retort temperature (CRT) processing (Teixeria et al., 1975, Banga et al., 1991, Banga et al., 2003, Chen and Ramaswamy, 2002).
Optimization of thermal sterilization is an optimal control problem, where it is necessary to search for the best retort temperature as a function of process time. Banga et al. (1991) showed that this optimal control problem could be transformed into a nonlinear programming (NLP) problem, and in most cases the NLP problem became a multi-modal optimization problem with several types of constraints. These types of optimization problems make use of classical deterministic optimization methods within a local search domain, such as, Hooke-Jeeves, Nelder-Mead, and Quasi-Newton (Himmelblau, 1972); and are frequently limited in their effectiveness. In order to ensure a global solution of these problems, it would be more suitable to use global optimization methods.
This research suggests a modification of the adaptive random search method based on the utilization of the well-known logistic function or logistic curve in order to improve the random search adaptation characteristics. An interesting and important food industry optimization problem, such as thermal processing, was solved by the new organization of adaptive random search.
Section snippets
Adaptive random search method
Let be a perspective interval for variable , and 2q be the width of each perspective interval. Let I be a Cartesian product of sets . Let I be (for the random search) a perspective sub-domain with center point .
The pedestal distribution is utilized in the adaptive random search as a probability distribution . After every calculation of (1) the pedestal distribution of is modified so that the probability of finding the optimal value of the
Results and discussion
In order to demonstrate the fact that the proposed modification of adaptive random search can produce superior results over the basic random search algorithm, the following well-known global tests problems were chosen (Table 1). The logistic curve shown in Fig. 2 was utilized for all numerical experiments done.
The results obtained by two random search algorithms are showed in the Fig. 3 through to 5, where is the experimental probability of obtaining the global solution with accuracy ;
Conclusion
The modification of the adaptive random search based on the well founded empirically logistic curve utilization has been proposed. The proposed modification presented here produced superior results over the basic random search algorithm, especially in the case of multi-modal or dynamics optimization, where as minimum optimization problem computations as possible to reach global optimum location are needed.
Future works will be focused on utilizing the proposed modification with the possibility
Acknowledgements
Author Ricardo Simpson is grateful for the financial support provided by CONICYT through the FONDECYT project number 1070946. Author Sergio Almonacid is grateful for the financial support provided by CONICYT through the FONDECYT project number 1070512.
References (49)
- et al.
Population set based global optimization algorithms: some modifications and numerical studies
Comput. Oper. Res.
(2004) - et al.
Optimization of thermal processing of conduction-heated canned foods: study of several objective functions
Journal of Food Engineering
(1991) - et al.
Improving food processing using modern optimization methods
Trends in Food Science and Technology
(2003) - et al.
Dynamic optimization of bioprocesses: efficient and robust numerical strategies
Journal of Biotechnology
(2005) - et al.
Modeling and optimization of variable retort temperature (VRT) thermal processing using coupled neural networks and genetic algorithms
Journal of Food Engineering
(2002) - et al.
A model of the cumulative distribution function for wide band radiative properties
JQSRT
(1998) - et al.
A modified logistic model to describe gadolinium kinetics in breast tumors
Magnetic Resonance Imaging
(2004) - et al.
Dynamic optimization using adaptive control vector parameterization
Comp. Chem. Eng.
(2005) - et al.
Variable retort temperature optimization using adaptive random search techniques
Journal of Food Control
(2008) - et al.
Ant colony optimization for continuous domains
European Journal of Operational Research
(2008)
Monotonous random search on a torus: integral upper bounds for the complexity
Journal of Statistical Planning and Inference
Adaptive population-based search: application to estimation of nonlinear regression parameters
Computational Statistics and Data Analysis
The Statistical Research of Random Search. Mathematical models. Theory and Application
Survey of Multiobjective Optimisation in Engineering Design, Reports of the Department of Mechanical Engineering, LiTH-IKP-R-1097
Global optimization of chemical processes using stochastic algorithms
Animal Ecology
A First Course in Chaotic Dynamical Systems
Optimization, Learning and Natural Algorithms
Ant Colony System: a cooperative learning approach to the traveling salesman problem
IEEE Transactions on Evolutionary Computation
Ant Colony Optimization
Computing optimal operating policies for the food industry
Journal of Food Engineering
Tabu search – part I
ORSA Journal on Computing
Cited by (20)
Simultaneous multi-product sterilization: Revisited, explored, and optimized
2019, Journal of Food EngineeringCitation Excerpt :From a theoretical point of view, in some cases, it is possible to quantify the impact that heat treatment has on product quality. Starting with the seminal manuscripts by Teixeira et al. (1969) and by Hayakawa et al. (1969), many articles have been published that addressed, from a theoretical point of view, the impact that thermal processing has on the quality of the food product (Abakarov et al., 2009; Abbatemarco and Ramaswamy, 1994; Aishima and Nakai, 1986; Avila et al., 2006; Batmaz and Sandeep, 2015; Cariño-Sarabia and Vélez-Ruiz, 2013; Downes and Hayakawa, 1977; Durance, 1997; Hayakawa, 1971; Singh et al., 2015). Although of much scientific interest, the procedures used in these works are not generally applicable to any thermally processed foods because these procedures have been designed for solid homogeneous foods (e.g., Teixeira et al., 1969).
Thermal food processing optimization: Algorithms and software
2013, Journal of Food EngineeringCitation Excerpt :The computation time spent by “OPT-PROx” for the computation of optimal temperature profile was equal to 15.45 min. This result shows that little benefit was gained from increasing significantly the processing time from 88.4 to 111.0 min, which is in accordance with the studies reported earlier (Teixeira et al., 1975; Banga et al., 1991; Durance, 1997; Abakarov et al., 2009b). Findings from this study would suggest that the developed user-friendly interfaces and the utilized numerical approaches make the simulation and optimization of the thermal food processing easy and adaptable.
Hybrid adaptive random search and genetic method for reaction kinetics modelling: CO <inf>2</inf> absorption systems
2012, Journal of Cleaner ProductionRecent cleaner production advances in process monitoring and optimisation
2012, Journal of Cleaner ProductionCitation Excerpt :The authors developed a hybrid algorithm for kinetics modelling based on the Adaptive Random Search Method (ARSM) enhanced by the Genetic Algorithms (GA) theory. The ARSM was used in practical implementations to find the global minimum for a function on a compact set (Abakarov et al., 2009). To enhance optimisation methods, combinations of different algorithms are frequently tested.