Improving classification performance of sonar targets by applying general regression neural network with PCA
Introduction
Automatic identification and classification of underwater signals on the basis of sonar signals are challenging problem due to the complexity of the ocean environment. Identification by human experts is usually not objective and a very heavy workload. Neural networks with their adaptive and computational advantages appear to be ideally suited to active sonar classification. The pioneer paper by Gorman and Sejnowski, 1988a, Gorman and Sejnowski, 1988b were perhaps the first papers which reported the application of neural networks to this area. They used simple spectral features as the input to the neural network classifier in order to distinguish a mine from cylindrical shaped rock positioned on a sandy ocean floor. After these pioneer papers, there has been growing interest in the use of neural networks for the automatic recognition of sonar targets. Among the several neural classifiers, multi-layer perceptron (MLP) classifier has been used in several applications about sonar target classification (Gorman and Sejnowski, 1988a, Gorman and Sejnowski, 1988b, Jing and El-Hawary, 1994, Shazeer and Bello, 1991). Radial basis function networks (RBFN) (Chen, 1992, Yegnanarayana et al., 1992), probabilistic neural networks (PNN) (Chen, 1992), general regression neural networks (Kapanoğlu & Yıldırım, 2004), and conic section function neural networks (CSFNN) (Erkmen & Yıldırım, 2006) have been also the efficient feed-forward neural networks widely used to classify sonar signal in literature.
Feature extraction is the important preprocessing step to classification of complex signal such as vision, speech identification or the problem mentioned here of detecting objects in sonar returns. Input dimensionality of these problems becomes a serious drawback to classification. Feature extraction techniques such as PCA, and neural discriminating analysis (NDA) reduce a high dimensional signal to a lower dimensional feature set, which preserves the most useful and relevant information on the feature space. In (Larkin, 1997, Soares-Filho et al., 2001), several feature extraction techniques were used to preprocess given sonar signals.
Recently, general regression neural network (GRNN) is successfully used in pattern recognition and image processing due to the advantages on fast learning and convergence to the optimal regression surface as the number of samples becomes very large (Polat & Yildirim, 2006). In this paper, GRNN has been used to classify sonar returns from two different targets on the sandy ocean bottom a mine and cylindrical shaped rock. The emphasis here is not the classifier itself, but also the process of the feature extraction technique, PCA, improves classifier performance. In this paper, the receiver operation characteristics (ROC) analysis (Woods & Bowyer, 1994) has been also applied to the neural classifier to show the accuracy of classification. ROC analysis is an established method of measuring diagnostic performance in sonar studies.
This paper organized as follows. Section 2 briefly describes the GRNN structure. PCA technique is examined in Section 3. Section 4 presents some concepts related to ROC analysis. In Section 5, the neural classifier designs, simulation results and performance evaluation with ROC analysis are presented. Finally, Section 6 outlines some conclusions.
Section snippets
General regression neural networks (GRNN)
General regression neural networks (GRNN) are memory-based network that provides estimates of continuous variables and converges to the underlying (linear or nonlinear) regression surface. GRNN is a one pass learning algorithm with highly parallel structure. It does not require an iterative training procedure as in MLP. The principal advantages of GRNN are fast learning and convergence to the optimal regression surface as the number of samples becomes very large. GRNNs have been shown to
Traditional principal component analysis
Principal component analysis is a multivariable statistical analysis technique of data compression and feature extraction. Envisaging practical applications that require online operations for the classifiers, an attractive approach for the classifier design is to reduce the dimensionality of the N-dimensional input space by projecting input data onto a reduced a number of M directions (M ≪ N) that can facilitate the classification task. The PCA describes the original data space in a base of
Receiver operating characteristic (ROC) analysis
ROC analysis is an established method of measuring diagnostic performance for the analysis of radar images. The ROC curve is a good measure when performance of different schemes needs to be compared. The evaluation criteria are based on the ROC curve, used in sonar target classification system to indicate trade-off of the conditional probability of correct classification versus conditional probability of false-alarm responses. Equivalently, the ROC curve is a graphical representation of the
Simulation results
The aim of this study is to employ general regression neural networks to classify sonar returns. To improve classification performance and simplify network complexity, PCA is used as feature extraction method. The data set, which is the original sonar data used by Gorman and Sejnowski, 1988a, Gorman and Sejnowski, 1988b was taken from the University of California collection of machine-learning-databases. Although this data set is an old one, it is a well-known benchmark for sonar problems. This
Conclusion
In this paper, a GRNN has been used to classify underwater target collected from two sources: a metal cylinder and similarly shaped rock. The emphasis in here is not the classifier itself, but also the process of the feature extraction technique, PCA. When the performance of GRNN using with PCA are compared with the performance of GRNN using without PCA in terms of successful classification rates, it is realized that PCA improves the neural classifier performance significantly. The low
References (15)
- et al.
Analysis of hidden units in a layered network trained to classify sonar targets
Neural Networks
(1988) - Chen, C. H. (1992). Neural networks for active sonar classification. Pattern recognition, vol. II. conference B:...
- et al.
Conic section function neural networks for sonar target classification and performance evaluation using ROC analysis
- et al.
Learned classification of sonar targets using a massively parallel network
IEEE Transactions on Acoustics, Speech, and Signal Processing
(1988) - Jing, Y., & El-Hawary, F. (1994). A multilayered ANN architecture for underwater target tracking. Electrical and...
- Kapanoğlu, B., & Yıldırım T., (2004). Generalized regression neural networks for underwater target classification....
- Kusy, M., & Zajdel, R. (2005). Comparison of two radial function based models: support vector machine and neural...
Cited by (74)
Unraveling complex data diversity in underwater acoustic target recognition through convolution-based mixture of experts
2024, Expert Systems with ApplicationsOpen-set recognition with long-tail sonar images
2024, Expert Systems with ApplicationsFault detection and isolation of gas turbine using series–parallel NARX model
2022, ISA TransactionsEstimation of heavy metals using deep neural network with visible and infrared spectroscopy of soil
2020, Science of the Total EnvironmentUnderwater sonar image classification using adaptive weights convolutional neural network
2019, Applied AcousticsA Novel Subset Feature Selection Framework for Increasing the Classification Performance of SONAR Targets
2018, Procedia Computer Science