Abstract
A novel technique is proposed for maintaining the diversity of sample features and modeling imbalanced datasets in multi-channel time-varying signal classification. The RBF-LVQPNN consists of a time-varying signal input layer, an RBF process neuron hidden layer, an LVQ competition layer, a pattern layer, and a classifier. Dynamic clustering was used to divide samples in each pattern class into several pattern subclasses with similar features. Typical signal samples in the pattern subclasses are then used as the kernel centers for RBFPNs, to achieve embedding of the diversity signal class features. The output of the RBFPN layer was used as input to the LVQN. In the competition layer, the ‘winning’ neurons were selected to represent a pattern subclass. In the process of reorganizing pattern subclasses into pattern classes, subclass boundaries were combined into irregular class boundaries to reduce the overlap of decision spaces for different pattern classes. The RBF-LVQNN could improve the memory ability of typical signal features and discriminability of signals, realize structural and data constraints of the model, and improve the modeling property of imbalanced datasets. In this paper, the properties of the RBF-LVQPNN are analyzed and a comprehensive training algorithm is established. Experimental validation was performed with classification diagnoses from seven types of cardiovascular diseases based on 12-lead ECG signals. Results demonstrated that the proposed technique significantly improved both classification accuracy and generalizability comparing with other methods in the experiment.
Similar content being viewed by others
References
Papandreou-Suppappola A (2002) Applications in time-frequency signal processing, vol 10. CRC Press
Gacek A, Pedrycz W (2011) Ecg signal processing, classification and interpretation: a comprehensive framework of computational intelligence. Springer Science & Business Media
Chen L-F, Liao H-Y M, Ko M-T, Lin J-C, Yu G-J (2000) A new lda-based face recognition system which can solve the small sample size problem. Pattern Recogn 33(10):1713–1726
Alibeigi M, Hashemi S, Hamzeh A (2012) Dbfs: An effective density based feature selection scheme for small sample size and high dimensional imbalanced data sets. Data Knowl Eng 81:67–103
Bououden S, Chadli M, Karimi H R (2015) Control of uncertain highly nonlinear biological process based on takagi–sugeno fuzzy models. Signal Process 108:195–205
Sutskever I, Hinton G (2007) Learning multilevel distributed representations for high-dimensional sequences. In: Artificial intelligence and statistics, pp 548–555
Li D, Zhang J, Zhang Q, Wei X (2017) Classification of ecg signals based on 1d convolution neural network. In: 2017 IEEE 19th International Conference on e-Health Networking, Applications and Services (Healthcom). IEEE, pp 1–6
Xiong Z, Stiles M K, Zhao J (2017) Robust ecg signal classification for detection of atrial fibrillation using a novel neural network. In: 2017 Computing in Cardiology (CinC). IEEE, pp 1–4
Lange S, Riedmiller M (2010) Deep auto-encoder neural networks in reinforcement learning. In: The 2010 International Joint Conference on Neural Networks (IJCNN). IEEE, pp 1–8
Fei W, Ye X, Sun Z, Huang Y, Zhang X, Shang S (2016) Research on speech emotion recognition based on deep auto-encoder. In: 2016 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER). IEEE, pp 308–312
Qi J, Shi P, Hu L, Zhang T, Xie S (2019) Ecg characteristic wave detection based on deep recursive long short-term memory. J Med Imaging Health Inf 9(9):1920–1924
Erdogan H, Hershey J R, Watanabe S, Le Roux J (2015) Phase-sensitive and recognition-boosted speech separation using deep recurrent neural networks. In: 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, pp 708–712
Chauhan S, Vig L (2015) Anomaly detection in ecg time signals via deep long short-term memory networks. In: 2015 IEEE International Conference on Data Science and Advanced Analytics (DSAA). IEEE, pp 1–7
Wasikowski M, Chen X- (2009) Combating the small sample class imbalance problem using feature selection. IEEE Trans Knowl Data Eng 22(10):1388–1400
Gao Z, Zhang L-, Chen M-, Hauptmann A, Zhang H, Cai A-N (2014) Enhanced and hierarchical structure algorithm for data imbalance problem in semantic extraction under massive video dataset. Multimed Tools Appl 68(3):641–657
Charfi F, Kraiem A (2013) Enhanced approach for ecg classification based on wavelet transform and decision tree models. J Decis Syst 22(2):109–121
Leng B, Yu K, Jingyan QIN (2017) Data augmentation for unbalanced face recognition training sets. Neurocomputing 235:10–14
Almas A, Farquad MAH, Avala NS R, Sultana J (2012) Enhancing the performance of decision tree: A research study of dealing with unbalanced data. In: Seventh International Conference on Digital Information Management (ICDIM 2012). IEEE, pp 7–10
Yao X, Wang Z, Zhang H (2018) Identification method for a class of periodic discrete-time dynamic nonlinear systems based on sinusoidal esn. Neurocomputing 275:1511–1521
Liu L, Liu Y-J, Chen A, Tong S, Chen CL Philip (2020) Integral barrier lyapunov function-based adaptive control for switched nonlinear systems. Sci China Inf Sci 63(3):1–14
Broomhead D S, Lowe D (1988) Radial basis functions, multi-variable functional interpolation and adaptive networks. Technical Report, Royal Signals and Radar Establishment Malvern (United Kingdom)
Bishop C (1991) Improving the generalization properties of radial basis function neural networks. Neural Comput 3(4):579– 588
Sundararajan N, Saratchandran P, Lu Y W (1999) Radial basis function neural networks with sequential learning: Mran and its applications, vol 11. World Scientific
Er M J, Wu S, Lu J, Toh H L (2002) Face recognition with radial basis function (rbf) neural networks. IEEE Trans Neural Netw 13(3):697–710
Behloul F, Lelieveldt B PF, Boudraa A, Reiber J HC (2002) Optimal design of radial basis function neural networks for fuzzy-rule extraction in high dimensional data. Pattern Recogn 35(3):659–675
Korürek M, Doğan B (2010) Ecg beat classification using particle swarm optimization and radial basis function neural network. Expert Syst Appl 37(12):7563–7569
Shaohua XU, Xingui H (2004) Research and applications of radial basis process neural networks. J-Beijing Univ Aeronaut Astronaut 30(1):14–17
Liu K, Xu S, Feng N (2019) A radial basis probabilistic process neural network model and corresponding classification algorithm. Appl Intell 49(6):2256–2265
Kohonen T (1982) A simple paradigm for the self-organized formation of structured feature maps. In: Competition and cooperation in neural nets. Springer, pp 248–266
Carpenter G A, Grossberg S (1988) The art of adaptive pattern recognition by a self-organizing neural network. Computer 21(3):77–88
Kohonen T (1990) Improved versions of learning vector quantization. In: 1990 ijcnn international joint conference on Neural networks. IEEE, pp 545–550
Burrascano P (1991) Learning vector quantization for the probabilistic neural network. IEEE Trans Neural Netw 2(4):458–461
Karayiannis N B (1997) A methodology for constructing fuzzy algorithms for learning vector quantization. IEEE Trans Neural Netw 8(3):505–518
Keogh E J, Pazzani M J (2001) Derivative dynamic time warping. In: Proceedings of the 2001 SIAM international conference on data mining. SIAM, pp 1–11
Bezdek J C, Ehrlich R, Full W (1984) Fcm: The fuzzy c-means clustering algorithm. Comput Geosci 10(2-3):191–203
Pham DT, Oztemel E (1994) Control chart pattern recognition using learning vector quantization networks. Int J Prod Res 32(3):721–729
Zhang J-, Liu X, Dong J (2012) Ccdd: an enhanced standard ecg database with its management and annotation tools. Int J Artif Intell Tools 21(05):1240020
Mangia M, Haboba J, Rovatti R, Setti G (2011) Rakeness-based approach to compressed sensing of ecgs. In: 2011 IEEE Biomedical Circuits and Systems Conference (BioCAS). IEEE, pp 424–427
Zheng Y, Liu Q, Chen E, Ge Y, Zhao J L (2014) Time series classification using multi-channels deep convolutional neural networks. In: International Conference on Web-Age Information Management. Springer, pp 298–310
Sharma L D, Sunkaria R K (2018) Inferior myocardial infarction detection using stationary wavelet transform and machine learning approach. SIViP 12(2):199–206
Rajan D, Thiagarajan J J (2018) A generative modeling approach to limited channel ecg classification. In: 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, pp 2571–2574
Benítez I, Díez J-L, Quijano A, Delgado I (2016) Dynamic clustering of residential electricity consumption time series data based on hausdorff distance. Electr Power Syst Res 140:517–526
Driemel A, Krivošija A, Sohler C (2016) Clustering time series under the fréchet distance. In: Proceedings of the twenty-seventh annual ACM-SIAM symposium on Discrete algorithms. SIAM, pp 766–785
Napook P, Eiamkanitchat N (2015) The adaptive dynamic clustering neuro-fuzzy system for classification. In: Information Science and Applications. Springer, pp 721–728
Campello RJGB, Moulavi D, Sander J (2013) Density-based clustering based on hierarchical density estimates. In: Pacific-Asia conference on knowledge discovery and data mining. Springer, pp 160–172
Acknowledgements
This work was supported by the National Key Research and Development Program of China (2018YFC1406203) and the SDUST Research Fund.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wu, L., Wang, Y., Xu, S. et al. An RBF-LVQPNN model and its application to time-varying signal classification. Appl Intell 51, 4548–4560 (2021). https://doi.org/10.1007/s10489-020-02094-4
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10489-020-02094-4