Skip to main content

Handwritten Digit Recognition Using SVM Binary Classifiers and Unbalanced Decision Trees

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8814))

Abstract

In this work, we use SVM binary classifiers coupled with a binary classifier architecture, an unbalanced decision tree, for handwritten digit recognition. According to input variables, two classifiers were trained and tested. One using digit characteristics and the other using the whole image as input variables. Developed recently, the unbalanced decision tree architecture provides a simple structure for a multiclass classifier using binary classifiers. In this work, using the whole image as input, 100% handwritten digit recognition accuracy was obtained in the MNIST database. These are the best results published in the literature for the MNIST database.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Cheriet, M., Kharma, N., Liu, C.L., Suen, C.: Character Recognition Systems. Wiley, New Jersey (2007)

    Book  MATH  Google Scholar 

  2. Decoste, D., Schölkopf, B.: Training Invariant Support Vector Machines. Kluwer Academic Publishers, The Netherlands (2002)

    Google Scholar 

  3. Ciresan, D.C., Meier, U., Gambardella, L.M., Schmidhuber, J.: Convolutional Neural Network Committees for Handwritten Character Classification. In: International Conference on Document Analysis and Recognition (ICDAR), pp. 1135 –1139 (2011)

    Google Scholar 

  4. Ciresan, D., Meier, U., Schmidhuber, J.: Multi-column Deep Neural Networks for Image Classification. Dalle Molle Institute for Artificial Intelligence. IDSIA/USI-SUPSI, Manno, Switzerland (2012)

    Google Scholar 

  5. Chung, Y.Y., Wong, M.T.: Handwritten character recognition by Fourier descriptors and neural network. In: IEEE Region 10 Annual Conference on Speech and Image Technologies for Computing and Telecommunications, vol. 1, pp. 391–394 (2007)

    Google Scholar 

  6. Poon, J.C., Man, G.M.: An enhanced approach to character recognition by Fourier descriptor. In: ICCS/ISITA 1992, vol. 2, pp. 558–562 (1992)

    Google Scholar 

  7. Kussul, E., Baidyk, T.: Improved method of handwritten digit recognition tested on MNIST database. In: 15th International Conference on Vision Interface, vol. 22, pp. 971–981 (2004)

    Google Scholar 

  8. Masmoudi, M., Samet, M., Taktak, F., Alimi, A.M.: A hardware implementation of neural network for the recognition of printed numerals. In: The Eleventh International Conference on Microelectronics, pp. 113–116 (1999)

    Google Scholar 

  9. Mandalia, A.D., Pandya, A.S., Sudhakar, R.: A hybrid approach to recognize handwritten alphanumeric characters. In: International Conference on System, Man and Cybernetics, vol. 1, pp. 723–726 (1992)

    Google Scholar 

  10. Travieso, C.M., Alonso, J., Ferrer, M.A.: Combining different off-line handwritten character recognizers. In: 15th International Conference on Intelligent Engineering Systems, Propad, pp. 315–318 (2011)

    Google Scholar 

  11. Oh, I.-S., Suen, C.Y.: A class-modular feedforward neural network for handwriting recognition. Pattern Recognition 35(1), 229–244 (2002)

    Article  MATH  Google Scholar 

  12. LeCun, Y., Cortes, C., Burges, C.J.: The MNIST database of Handwritten Digits, http://yann.lecun.com/exdb/mnist/ (accessed in January 02, 2014)

  13. Deng, L.: The MNIST Database of Handwritten Digit Images for Machine Learning Research. IEEE Signal Processing Magazine, 141–142 (2012)

    Google Scholar 

  14. Hassan, A., Damper, R.I.: Classification of emotional speech using 3DEC hierarchical classifier. Speech Communication 54, 903–916 (2012)

    Article  Google Scholar 

  15. Ramanan, A., Suppharangsan, S., Niranjan, M.: Unbalanced Decision Trees for Multi-class Classification. In: International Conference on Industrial and Information Systems, Sri Lanka, pp. 291–294 (2007)

    Google Scholar 

  16. Theodoridis, S., Koutroumbas, K.: Pattern Recognition. Elsevier Academic Press, San Diego (2006)

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cícero Ferreira Fernandes Costa Filho .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Gil, A.M., Costa Filho, C.F.F., Costa, M.G.F. (2014). Handwritten Digit Recognition Using SVM Binary Classifiers and Unbalanced Decision Trees. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2014. Lecture Notes in Computer Science(), vol 8814. Springer, Cham. https://doi.org/10.1007/978-3-319-11758-4_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11758-4_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11757-7

  • Online ISBN: 978-3-319-11758-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics