One-class classification is an important problem with applications in several different areas such as outlier detection and machine monitoring. In this paper we propose a novel method for one-class classification, referred to as kernel k-NNDDSRM. This is a modification of an earlier algorithm, the kNNDDSRM, which aims to make the method able to build more flexible descriptions with the use of the kernel trick. This modification does not affect the algorithm’s main feature which is the significant reduction in the number of stored prototypes in comparison to NNDD. Aiming to assess the results, we carried out experiments with synthetic and real data to compare the method with the support vector data description (SVDD) method. The experimental results show that our oneclass classification approach outperformed SVDD in terms of the area under the receiver operating characteristic (ROC) curve in six out of eight data sets. The results also show that the kernel kNNDDSRM remarkably outperformed kNNDDSRM.
Chapter PDF
Similar content being viewed by others
Keywords
- Receiver Operate Characteristic Curf Curve
- Outlier Detection
- Near Neighbor
- Novelty Detection
- Structural Risk Minimization
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Asuncion, A., Newman, D.: UCI machine learning repository (2007). URL www.ics.uci.edu/∼mlearn/MLRepository.html
Bishop, C.M.: Novelty detection and neural network validation. IEE Proceedings — Vision, Image and Signal Processing 141(4), 217-222 (1994). Document No. 19941330
Cabral, G.G., Oliveira, A.L.I., Cahú, C.B.G.: A novel method for one-class classification based on the nearest neighbor rule and structural risk minimization. In: Proc. IJCNN’2007, International Joint Conference on Neural Networks, pp. 1976-1981 (2007)
Cabral, G.G., Oliveira, A.L.I., Cahú, C.B.G.: Combining nearest neighbor data description and structural risk minimization for one-class classification. Neural Computing & Applications (2008). Accepted for publication
Cao, L., Lee, H.P., Chong, W.K.: Modified support vector novelty detector using training data with outliers. Pattern Recognition Letters 24(14), 2479-2487 (2003)
ık, P., Pekalska, E., Tax, D.M.J.: PR-Tools 4.0, a Matlab toolbox for pattern recognition. http://www.prtools.org (2004)
Hanson, S.J., new Brunswick, G.S., Kulikowski, C., Japkowicz, N.: Concept-learning in the absence of counter-examples: An autoassociation-based approach to classification. Tech. rep. (1999). URL http://citeseer.ist.psu.edu/222433.html
Karacali, B., Krim, H.: Fast minimization of structural risk by nearest neighbor rule. IEEE Trans. on Neural Networks 14, 127-137 (2003)
Markou, M., Singh, S.: Novelty detection: a review - part 1: statistical approaches. Signal Processing 83(12), 2481-2497 (2003)
Markou, M., Singh, S.: Novelty detection: a review-part 2: neural network based approaches. Signal Processing. Dec. 2003; 83(12): 2499-521 (2003)
Marsland, S., Nehmzow, U., Shapiro, J.: On-line novelty detection for autonomous mobile robots. Robotics and Autonomous Systems 51(2-3), 191-206 (2005)
Moya, M.M., Koch, M.W., Hostetler, L.D.: One-class classifier networks for target recognition applications. In: Proc. WCNN’93, World Congress on Neural Networks, vol. III, pp. 797-801. INNS, Lawrence Erlbaum, Hillsdale, NJ (1993)
Ritter, G., Gallegos, M.T.: Outliers in statistical pattern recognition and an application to automatic chromosome classification. Pattern Recognition Letters 18(6), 525-539 (1997)
Salvador, S.W.: Learning states for detecting anomalies in time series. Master’s thesis, Florida Institute of Technology (2004)
Tax, D.M.J.: One-class classificationconcept-learning in the absence of counter-examples. Ph.D. thesis, Technische Universiteit Delft (2001)
Vapnik, V.: Statistical Learning Theory. Wiley (1998)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2008 International Federation for Information Processing
About this paper
Cite this paper
Cabral, G.G., Oliveira, A.L.I. (2008). A Comparative Analysis of One-class Structural Risk Minimization by Support Vector Machines and Nearest Neighbor Rule. In: Bramer, M. (eds) Artificial Intelligence in Theory and Practice II. IFIP AI 2008. IFIP – The International Federation for Information Processing, vol 276. Springer, Boston, MA. https://doi.org/10.1007/978-0-387-09695-7_24
Download citation
DOI: https://doi.org/10.1007/978-0-387-09695-7_24
Publisher Name: Springer, Boston, MA
Print ISBN: 978-0-387-09694-0
Online ISBN: 978-0-387-09695-7
eBook Packages: Computer ScienceComputer Science (R0)