Robust optimization of ANFIS based on a new modified GA
Introduction
Modeling techniques are classified into mechanistic and empirical. Mechanistic models such as regression require complex physical understanding of the modeling process [3], [47]. Also there are not enough suitable explicit models for the various processes [4]. Thus, empirical models such as artificial neural network (ANN) and fuzzy logic (FL) are commonly employed by many processes [27].
ANN is the most common empirical techniques applied for modeling. On the other hand, FL also plays an important role in input–output and in-process parameter relationship modeling [33] to describe human thinking and reasoning in a mathematical framework [34]. As well, integration of ANN and FL or adaptive network-based fuzzy inference systems (ANFIS) is considered efficiently as a modeling technique. ANFIS is a hybrid technique which integrates the advantage of learning in ANN and employing a set of fuzzy if–then rules with appropriate membership functions to generate input–output pairs with high degree of accuracy [18], [24], [2], [32]. In the recent years, ANFIS system is widely employed to produce non-linear models of processes to determine the input–output relationship. As well, the authors Cus et al. [6] and Mukherjee and Ray [33] observed that ANFIS technique is an effective means of control in complex manufacturing process.
Although, ANFIS is a robust modeling technique in various applications, but it has some disadvantages of artificiality, randomness and irregularity [48] and needs to be trained to work successfully. Consequently, an effective training algorithm is applied to find optimal values of adaptive modeling parameters. The main problem discussed is complexity of training membership functions׳ parameters (premise parameters) and fuzzy rules׳ parameters (consequent parameters). So they become very important parameters in training process [38]. The basic and most usual training algorithm is based on gradient descent (GD), while calculation of that in each step of training is difficult and the use of chain rule may cause trapping into local minimum [18], [21].
In the recent years, some affords have been done to find optimal value for modeling parameters in order to decline training error and increase the modeling accuracy such as Li et al. [23]. Genetic algorithm (GA) is an optimization technique which has been employed effectively by the previous researchers to determine optimal values of modeling parameters [16] and improve the training accuracy performance [21]. The researchers, Rangajanardhaa and Rao [36], Carrano et al. [5], Wei and Cheng [42], and Wang et al. [41] employed GA as a training algorithm to increase the accuracy of ANFIS and minimize the prediction error during training and testing of the network. As well, Wei [43] utilized ANFIS–GA model for Stock market forecasting. In addition, Ho et al. [15] applied a new modified GA based on Taguchi method as ANFIS training algorithm. Also, [37] developed a training algorithm for ANFIS based on HL which is the integration of least squares and back propagation gradient descent methods. Furthermore, LOO-CV approach was employed by Dong and Wang [11] for training a prediction model based on ANFIS. As well, Sharkawy [37] developed radial basis function neural networks to get the best prediction accuracy for a process. Moreover, Yang et al. [44], [45] presented the Grid Partition Method (GPM) to integrate the advantages of GA and genetic programming in ANFIS training.
In this paper, a new modified GA is employed as ANFIS training algorithm to estimate the most suitable membership function and fuzzy rules for the model and find the best prediction model by improving prediction accuracy. An experimental dataset on a machining process is considered as a test case in this study to show the effectiveness of proposed hybrid modeling technique (ANFIS–GA). Additionally, the prediction results of the proposed model are compared with several techniques considered in the literature. Moreover, some results are given to show the performance of various MGA factors on prediction error.
Section snippets
ANFIS training
The basic architecture of ANFIS consists of five layers [20] with different functions. Two layers in the model include adaptive parameters while the parameters considered in the others are fixed. Adaptive parameters are classified into premise and consequent parameters. Premise parameters in the model are related to the membership functions determined in the first layer [18] such as Gaussian function (see Eq. (1)).where and are the premise parameters. By changing the
Modified genetic algorithm (MGA)
Genetic algorithm (GA) is a stochastic optimization technique which starts with a collection of random solutions (chromosome). These chromosomes progress in consecutive iterations and are measured by a fitness function. As the evolution procedure continues, GA search procedure finally converges to an optimal chromosome [32]. Optimization result in GA is started with generating a random population (as current population) and is based on three basic functions called selection, crossover, and
The proposed hybrid prediction model
MGA optimization technique is developed in this paper as training algorithm to optimize the modeling parameters of the ANFIS. This technique is organized to minimize the following objective function,where G is RMSE value of the performances predicted by ANFIS while it is set by modeling parameters . As well, is the number of modeling parameters which need to be optimized. Also, there are some constraints on the input parameters values bounds which are satisfied by
Experimental design
The proposed hybrid approach (ANFIS–MGA) is applied and evaluated to model an end milling process with the experimental data conducted by Lou and Chen [26] where it is then referred by Dong and Wang [11], Lo [24], and Ho et al. [15]. In the experiment, a high-speed steel (HSS) four-flute end milling cutter with a diameter of 3/4″ was used to machine 6061 aluminum alloy. Spindle speed (), feed rate () and depth of cut () have been selected as the machining parameters with three linguistic
Modeling results
The proposed algorithms were implemented by using Matlab R2009a. The modeling result is presented in two parts. In the first part, the optimization result of modeling parameters after training process are addressed to show the best fuzzy rules and membership function in the experiment. Then, the prediction results of the ANFIS model using testing dataset are measured to indicate the effectiveness of the proposed training algorithm.
Conclusion and future works
In this paper, a hybrid technique based on ANFIS and modified genetic algorithm (MGA) was proposed as an effective prediction model in machining processes. In the proposed hybrid technique, MGA was utilized to find optimal modeling parameters to generate the best membership functions and fuzzy rules for ANFIS. MGA employed a new type of population and fitness function to considerably enhance the quality of the initial population, convergence speed and accuracy of the model. The main properties
Arezoo Sarkheyli Ph.D. Researcher in Soft Computing Research Group, Faculty of Computing, Universiti Teknologi Malaysia, 81310 UTM Skudai, Johor, Malaysia.
References (29)
- et al.
Adaptive network-based fuzzy inference system with leave-one-out cross-validation approach for prediction of surface roughness
Appl. Math. Model.
(2011) Adaptive network-based fuzzy inference system for prediction of surface roughness in end milling process using hybrid Taguchi-genetic learning algorithm
Expert Syst. Appl.
(2009)An ANFIS-based model for predicting adequacy of vancomycin regimen using improved genetic algorithm
Expert Syst. Appl.
(2011)Modeling customer satisfaction for new product development using a PSO-based ANFIS approach
Appl. Soft Comput.
(2012)An adaptive-network based fuzzy inference system for prediction of workpiece surface roughness in end milling
J. Mater. Process. Technol.
(2003)- et al.
Neural-network system for predicting machining behavior
J. Mater. Process. Technol.
(1995) - et al.
Statistical validation
Ecol. Model.
(1993) - et al.
Modified genetic algorithms for manufacturing process planning in multiple parts manufacturing lines
Expert Syst. Appl.
(2011) - et al.
A review of optimization techniques in metal cutting processes
Comput. Ind. Eng.
(2006) A neuro-fuzzy computing technique for modeling hydrological time series
J. Hydrol.
(2004)
Optimization of multi-pass milling using parallel genetic algorithm and parallel genetic simulated annealing
Int. J. Mach. Tools Manuf.
ANFIS model based on multiple stock market volatility causality for TAIEX forecasting
Applied Soft Computing
Application of GA to optimize cutting conditions for minimizing surface roughness in end milling machining process
Expert Syst. Appl.
Combining fuzzy logic and neural networks in modeling landfill gas production
World Acad. Sci. Eng. Technol.
Cited by (71)
Robust hybrid learning approach for adaptive neuro-fuzzy inference systems
2024, Fuzzy Sets and SystemsScope of machine learning in materials research—A review
2023, Applied Surface Science AdvancesA hybrid GA-ANFIS and F-Race tuned harmony search algorithm for Multi-Response optimization of Non-Traditional Machining process
2022, Expert Systems with ApplicationsHairpin RNA genetic algorithm based ANFIS for modeling overhead cranes
2022, Mechanical Systems and Signal ProcessingCitation Excerpt :Esfahani et al. introduced GA based ANFIS for determining optimum mesh density [32]. In [33], Sarkheyli et al. presented a new modified genetic algorithm to optimize the modeling parameters of membership functions and fuzzy rules in ANFIS. Basic GA has some shortages such as poor local searching ability, premature convergence and “Hamming-cliffs” problems.
A Novel Breast Cancer Diagnosis Scheme With Intelligent Feature and Parameter Selections
2022, Computer Methods and Programs in BiomedicineBuilding fuzzy relationships between compressive strength and 3D microstructural image features for cement hydration using Gaussian mixture model-based polynomial radial basis function neural networks
2021, Applied Soft ComputingCitation Excerpt :ANFIS adopts a network structure with five layers, in which the premise parameters are learned by gradient descent (GD) and the consequent parameters are determined by least squares estimation (LSE). Continuously, heuristic algorithms such as particle swarm optimization (PSO) [35], genetic algorithm (GA) [36] and artificial bee colony (ABC) [37] are used in training ANFIS. Recently, Wu et al. [38] optimized Takagi–Sugeno–Kang (TSK) fuzzy systems [39] using minibatch gradient descent with regularization, dropRule, and AdaBound.
Arezoo Sarkheyli Ph.D. Researcher in Soft Computing Research Group, Faculty of Computing, Universiti Teknologi Malaysia, 81310 UTM Skudai, Johor, Malaysia.
Azlan Mohd Zain Senior Lecturer in Soft Computing Research Group, Faculty of Computing, Universiti Teknologi Malaysia, 81310 UTM Skudai, Johor, Malaysia.
Safian Sharif Associate Professor in Department of Manufacturing and Industrial Engineering, Faculty of Mechanical Engineering, Universiti Teknologi Malaysia, 81310 UTM Skudai, Johor, Malaysia.