Abstract
Outliers are the deformities in the data that diverges from the normal behavior. Detection of outlier points is a crucial task as it leads to the extraction of the discordant observations in different domains. One of the most popular density-based outlier detection techniques is local outlier factor (LOF), and later many variants of this approach are also introduced. These techniques have more execution time as they calculate the outlier score for every data point. In this paper, we propose an approach that first detects the data points which have a high probability of being an outlier (i.e., probable outliers) based on Z-score and modified Z-score statistical techniques. Subsequently, we compute the anomaly score of only these probable outliers. Therefore, we avoid to calculate the outlier score of a substantial number of data points. We conducted experiments on synthetic dataset as well as on real-world datasets, and experimental results demonstrate that our proposed approaches outperform the popular outlier detection technique LOF and its variants.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. CSUR 41(3), 15 (2009)
Breunig, M.M., Kriegel, H.P., Ng, R.T., Sander, J.: LOF: identifying density-based local outliers. In: Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, pp. 93–104 (2000)
Tang, J., Chen, Z., Fu, A.W.C., Cheung, D.W.: Enhancing effectiveness of outlier detections for low density patterns. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 535–548. Springer, Berlin, Heidelberg (2002)
Zhang, K., Hutter, M., Jin, H.: A new local distance-based outlier detection approach for scattered real-world data. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 813–822 (2009)
Hubballi, N., Patra, B.K., Nandi, S.: NDoT: nearest neighbor distance based outlier detection technique. In: International Conference on Pattern Recognition and Machine Intelligence, pp. 36–42 (2011)
Knorr, E.M., Ng, R.T.: Algorithms for mining distance-based outliers in large datasets. VLDB 98, 392–403 (1998)
Jin, W., Tung, A.K., Han, J.: Mining top-n local outliers in large databases. In: Proceedings of the Seventh ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 293–298 (2001)
Salehi, M., Leckie, C., Bezdek, J.C., Vaithianathan, T.: Local outlier detection for data streams in sensor networks: revisiting the utility problem invited paper. In: 2015 IEEE Tenth International Conference on Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), pp. 1–6. IEEE (2015)
Salehi, M., Leckie, C., Bezdek, J.C., Vaithianathan, T., Zhang, X.: Fast memory efficient local outlier detection in data streams. IEEE Trans. Knowl. Data Eng. 28(12), 3246–3260 (2016)
Alshawabkeh, M., Jang, B., Kaeli, D.: Accelerating the local outlier factor algorithm on a GPU for intrusion detection systems. In: Proceedings of the 3rd Workshop on General-Purpose Computation on Graphics Processing Units, pp. 104–110 (2010)
Goldstein, M.: FastLOF: an expectation-maximization based local outlier detection algorithm. In: Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 2282–2285. IEEE (2012)
Poddar, S., Patra, B.K.: Reduction in execution cost of k-nearest neighbor based outlier detection method. In: International Conference on Mathematics and Computing, pp. 53–60. Springer, Singapore (2018)
Iglewicz, B., Hoaglin, D.C.: How to Detect and Handle Outliers, vol. 16. ASQ Press (1993)
Jin, W., Tung, A.K., Han, J., Wang, W.: Ranking outliers using symmetric neighborhood relationship. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 577–593. Springer, Berlin, Heidelberg (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Abhaya, Gupta, M., Patra, B.K. (2022). Accelerating LOF Outlier Detection Approach. In: Gupta, D., Goswami, R.S., Banerjee, S., Tanveer, M., Pachori, R.B. (eds) Pattern Recognition and Data Analysis with Applications. Lecture Notes in Electrical Engineering, vol 888. Springer, Singapore. https://doi.org/10.1007/978-981-19-1520-8_15
Download citation
DOI: https://doi.org/10.1007/978-981-19-1520-8_15
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-1519-2
Online ISBN: 978-981-19-1520-8
eBook Packages: Computer ScienceComputer Science (R0)