Abstract
Naïve Bayes nearest neighbors (NBNN) is a variant of the classic KNN classifier that has proved to be very effective for object recognition and image classification tasks. Under NBNN an unseen image is classified by looking at the distance between the sets of visual descriptors of test and training images. Although NBNN is a very competitive pattern classification approach, it presents a major drawback: it requires of large storage and computational resources. NBNN’s requirements are even larger than those of the standard KNN because sets of raw descriptors must be stored and compared, therefore, efficiency improvements for NBNN are necessary. Prototype generation (PG) methods have proved to be helpful for reducing the storage and computational requirements of standard KNN. PG methods learn a reduced subset of prototypical instances to be used by KNN for classification. In this contribution we study the suitability of PG methods for enhancing the capabilities of NBNN. Throughout an extensive comparative study we show that PG methods can reduce dramatically the number of descriptors required by NBNN without significantly affecting its discriminative performance. In fact, we show that PG methods can improve the classification performance of NBNN by using much less visual descriptors. We compare the performance of NBNN to other state-of-the-art object recognition approaches and show the combination of PG and NBNN outperforms alternative techniques.
Chapter PDF
Similar content being viewed by others
References
Boiman, O., Shechtman, E., Irani, M.: In defense of nearest-neighbor based image classification. In: CVPR, pp. 1–8 (2008)
Chang, L., Duarte, M.M., Sucar, L.E., Morales, E.F.: A bayesian approach for object classification based on clusters of sift local features. Expert Syst. Appl. 39, 1679–1686 (2012)
Chen, C.H., Jozwik, A.: A sample set condensation algorithm for the class sensitive artificial neural network. Pattern Recog. Lett. 17(8), 819–823 (1996)
Decaestecker, C.: Finding prototypes for nearest neghbour classification by means of gradient descent and det. annealing. Pattern Recog. 30(2), 281–288 (1997)
Fayed, H.A., Hashem, S.R., Atiya, A.F.: Self-generating prototypes for pattern classification. Pattern Recog. 40(5), 1498–1509 (2007)
Fernandez, F., Isasi, P.: Evolutionary design of nearest prototype classifiers. Journal of Heuristics 10, 431–454 (2004)
Garain, U.: Prototype reduction using an artificial immune system. Pattern Analysis and Applications 11(3-4), 353–363 (2008)
Geva, S., Sitte, J.: Adaptive nearest neighbor pattern classification. IEEE Transaction on Neural Networks 2(2), 318–322 (1991)
Hamamoto, Y., Uchimura, S., Tomita, S.: A bootstrap technique for nearest neighbor classifier design. IEEE Trans. Pattern Anal. Mach. Intell. 19(1), 73–79 (1997)
Hastie, T., Tibshirani, R., Friedman, J.: The Elements of Statistical Learning. Springer (2001)
Alcalá-Fdez, J., et al.: Keel: A software tool to assess evolutionary algorithms to data mining problems. Soft Computing 13(3), 307–318 (2009)
Jiu, M., Wolf, C., Garcia, C., Baskurt, A.: Supervised learning and codebook optimization for bag-of-words models. Cogn. Comput. 4(4), 409–419 (2012)
Kohonen, T.: The self organizing map. Proc. of IEEE 78(9), 1464–1480 (1990)
Koplowitz, J., Brown, T.: On the relation of performance to editing in nearest neighbor rules. Pattern Recog. 13(3), 251–255 (1981)
Lazebnik, S., Raginsky, M.: Supervised learning of quantizer codebooks by information loss minimization. IEEE Trans. PAMI 31(7), 1294–1309 (2009)
Lowe, D.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)
Nanni, L., Lumini, A.: Particle swarm optimization for prototype reduction. Neurocomputing 72(4-6), 1092–1097 (2008)
Olvera, A., Carrasco-Ochoa, J.A., Martinez-Trinidad, J.F., Kittler, J.: A review of instance selection methods. Artificial Intell. Rev. 34, 133–143 (2010)
Paredes, R., Vidal, E.: Learning prototypes and distances: a prototype reduction technique based on nearest neighbor error minimization. Pattern Recog. 39(2), 180–188 (2006)
Raicharoen, T., Lursinsap, C.: A divide-and-conquer approach to the pairwise opposite class-nearest neighbor (poc-nn) algorithm. Pattern Recog. Lett. 26, 1554–1567 (2005)
Sánchez, J.S.: High training set size reduction by space partitioning and prototype abstraction. pattern recognition. Pattern Recog. 37(7), 1561–1564 (2004)
Triguero, I., Derrac, J., García, S., Herrera, F.: A taxonomy and experimental study on prototype generation for nearest neighbor classification. IEEE Trans. on Systems, Man, and Cybernetics–Part C 42(1), 86–100 (2012)
Triguero, I., Derrac, J., Herrera, F., Garcia, S.: A study of the scaling up capabilities of stratified prototype generation. In: NaBIC, pp. 297–302. IEEE (2011)
Triguero, I., García, S., Herrera, F.: Differential evolution for optimizing the positioning of prototypes in nearest neighbor classification. Pattern Recog. 44(4), 901–916 (2011)
Triguero, I., Garcia, S., Herrera, F.: Ipade: Iterative prototype adjustment for nearest neighbor classification. IEEE Trans. Neural N. 21(12), 1984–1990 (2010)
Tuytelaars, T., Fritz, M., Saenko, K., Darrell, T.: The NBNN kernel. In: Proc. of the International Conference on Computer Vision, pp. 1824–1831. IEEE (2011)
Yen, C.W., Young, C.N., Nagurka, M.L.: A vector quantization method for nearest neighbor classifier design. Pattern Recog. Lett. 25(6), 725–731 (2004)
Zhang, J., Marszalek, M., Lazebnik, S., Schmid, C.: Local features and kernels for classification of texture and object categories: a comprehensive study. International Journal of Computer Vision 73, 213–238 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Escalante, H.J., Sotomayor, M., Montes, M., Lopez-Monroy, A.P. (2014). Object Recognition with Näive Bayes-NN via Prototype Generation. In: Martínez-Trinidad, J.F., Carrasco-Ochoa, J.A., Olvera-Lopez, J.A., Salas-Rodríguez, J., Suen, C.Y. (eds) Pattern Recognition. MCPR 2014. Lecture Notes in Computer Science, vol 8495. Springer, Cham. https://doi.org/10.1007/978-3-319-07491-7_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-07491-7_17
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07490-0
Online ISBN: 978-3-319-07491-7
eBook Packages: Computer ScienceComputer Science (R0)