Abstract
In recent years, with the evolution of technology and hardware, people can per-form anomaly detection on machines by collecting immediate time series data, thereby realizing the vision of an unmanned chemical factory. However, the data is often collected from multiple sensors, and multivariate time series anomaly detection is a difficult and complex problem because of the different scales and the unclear interaction of each feature. In addition, there usually exist noises in the data, and those make it difficult to predict the trend of the data. Moreover, practically, it’s hard to collect abnormal data, thus the imbalance is an important issue. Recently, with the rapid development of data science, unsupervised methods based on deep learning manner have gradually dominated the field of multivariate time series anomaly detection. In this paper, we propose a 3D-causal Temporal Convolutional Network based framework, namely TCN3DPredictor, to detect anomaly signals from sensors data. Our proposed TCN3DPredictor modifies multi-scale convolutional recurrent encoder-decoder by 3D-causal Temporal Convolutional Network which can learn the interaction and temporal correlation between features and even predict the next data. Based on the results of 3D-causal Temporal Convolutional Network, a new breed of statistical method is proposed in our proposed TCN3DPredictor to measure the anomaly score precisely. Through a series of experiments using dataset crawled from a computer numerical control (CNC) metal cutting machine tool in a precision machinery factory, we have validated the proposed TCN3DPredictor and shown that it has excellent effectiveness compared with state-of-the-art anomaly prediction methods under various conditions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
BBC: Taiwan train crash driver disabled speed controls https://www.bbc.com/news/world-asia-45951475.
- 2.
References
Bai, S., Kolter, J.Z., Koltun, V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv preprint arXiv:1803.01271 (2018)
Blázquez-García, A., Conde, A., Mori, U., Lozano, J.A.: A review on outlier/anomaly detection in time series data. ACM Comput. Surv. (CSUR) 54(3), 1–33 (2021)
Dopico, M., Gómez, A., De la Fuente, D., García, N., Rosillo, R., Puche, J.: A vision of industry 4.0 from an artificial intelligence point of view. In: Proceedings on the International Conference on Artificial Intelligence (ICAI), p. 407. The Steering Committee of The World Congress in Computer Science, Computer (2016)
Guo, H., Zhang, D., Jiang, L., Poon, K.W., Lu, K.: ASTCN: an attentive spatial-temporal convolutional network for flow prediction. IEEE Internet Things J. 9(5), 3215–3225 (2021)
Hallac, D., Vare, S., Boyd, S., Leskovec, J.: Toeplitz inverse covariance-based clustering of multivariate time series data. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 215–223 (2017)
Hautamaki, V., Karkkainen, I., Franti, P.: Outlier detection using k-nearest neighbour graph. In: Proceedings of the 17th International Conference on Pattern Recognition, 2004, ICPR 2004, vol. 3, pp. 430–433. IEEE (2004)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Jin, S., Mordasini, C.: Compositional imprints in density-distance-time: a rocky composition for close-in low-mass exoplanets from the location of the valley of evaporation. Astrophys. J. 853(2), 163 (2018)
Klambauer, G., Unterthiner, T., Mayr, A., Hochreiter, S.: Self-normalizing neural networks. In: Advances in Neural Information Processing Systems, vol. 30 (2017)
Liang, H., Song, L., Wang, J., Guo, L., Li, X., Liang, J.: Robust unsupervised anomaly detection via multi-time scale DCGANs with forgetting mechanism for industrial multivariate time series. Neurocomputing 423, 444–462 (2021)
Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., Shroff, G.: LSTM-based encoder-decoder for multi-sensor anomaly detection. arXiv preprint arXiv:1607.00148 (2016)
van den Oord, A., et al.: WaveNet: a generative model for raw audio. arXiv preprint arXiv:1609.03499 (2016)
Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434 (2015)
Shi, X., Chen, Z., Wang, H., Yeung, D.Y., Wong, W.K., Woo, W.C.: Convolutional LSTM network: a machine learning approach for precipitation nowcasting. In: Advances in Neural Information Processing Systems, vol. 28 (2015)
Song, D., Xia, N., Cheng, W., Chen, H., Tao, D.: Deep r-th root of rank supervised joint binary embedding for multivariate time series retrieval. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 2229–2238 (2018)
Tayeh, T., Aburakhia, S., Myers, R., Shami, A.: An attention-based ConvLSTM autoencoder with dynamic thresholding for unsupervised anomaly detection in multivariate time series. Mach. Learn. Knowl. Extr. 4(2), 350–370 (2022)
Yaacob, A.H., Tan, I.K., Chien, S.F., Tan, H.K.: Arima based network anomaly detection. In: 2010 Second International Conference on Communication Software and Networks, pp. 205–209. IEEE (2010)
Zhang, C., et al.: A deep neural network for unsupervised anomaly detection and diagnosis in multivariate time series data. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 1409–1416 (2019)
Zhao, P., Chang, X., Wang, M.: A novel multivariate time-series anomaly detection approach using an unsupervised deep neural network. IEEE Access 9, 109025–109041 (2021)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Kuo, CW., Ying, J.JC. (2023). An Unsupervised Deep Learning Framework for Anomaly Detection. In: Nguyen, N.T., et al. Intelligent Information and Database Systems. ACIIDS 2023. Lecture Notes in Computer Science(), vol 13995. Springer, Singapore. https://doi.org/10.1007/978-981-99-5834-4_23
Download citation
DOI: https://doi.org/10.1007/978-981-99-5834-4_23
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-99-5833-7
Online ISBN: 978-981-99-5834-4
eBook Packages: Computer ScienceComputer Science (R0)