Skip to main content
SpringerLink
Log in

AMRE: An Attention-Based CRNN for Manchu Word Recognition on a Woodblock-Printed Dataset

  • Conference paper
  • First Online:
Neural Information Processing (ICONIP 2022)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 13624))

Included in the following conference series:

Abstract

Ancient minority language character recognition could be challenging due to limited documentation, but it is always critical to better understand history and conduct social science researches. As an important minority language, Manchu language is confronted with the similar challenges due to the lack of systematic document studies. Recently, more researches focus on solving this problem through different approaches, such as document digitalization or character image segmentation. However, there are still some limitations. On one hand, existing digitalized Manchu documents are carried out based upon machine-printed style, which is not common in real historical documents and can cause severe recognition bias. On the other hand, most of Manchu identification methods are based on coarse image segmentation and may result in recognition error since it is difficult to consistently cut the words accurately. To tackle these two challenges, we propose a segmentation-free method for Manchu recognition with a medium scale dataset of Woodblock-printed Manchu Words (WMW). We first develop WMW based-upon woodblock-printed Manchu words, which are more common in ancient documents. With the developed dataset, we conduct document mining and carry out a framework, namely AMRE, with Attention-based Convolutional Recurrent Neural Network. AMRE leverages attention mechanism by weighted aggregation of the convolution results from differently sized kernels and more effectively mine the valid information of morphed words in recognition process. By implementing our proposed AMRE, the digitalized characters can be more accurately recognized. The experiment results show that the word recognition accuracy of AMRE exceeds the baseline by more than 5\(\%\).

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 69.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 89.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Shivakumara, P., Phan, T.Q., Tan, C.L.: A gradient difference based technique for video text detection. In: 2009 10th International Conference on Document Analysis and Recognition, pp. 156–160. IEEE (2009)

    Google Scholar 

  2. Mosleh, A., Bouguila, N., Hamza, A.B.: Image text detection using a bandlet-based edge detector and stroke width transform. In: BMVC, pp. 1–12 (2012)

    Google Scholar 

  3. Pan, Y.F., Hou, X., Liu, C.L.: A hybrid approach to detect and localize texts in natural scene images. IEEE Trans. Image Process. 20(3), 800–813 (2010)

    MathSciNet  MATH  Google Scholar 

  4. Ye, Q., Huang, Q., Gao, W., et al.: Fast and robust text detection in images and video frames. Image Vis. Comput. 23(6), 565–576 (2005)

    Article  Google Scholar 

  5. Rodríguez-Serrano, J.A., Perronnin, F.: A model-based sequence similarity with application to handwritten word spotting. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2108–2120 (2012)

    Article  Google Scholar 

  6. Wang, D., Li, Y., Wang, L., Gong, B.: Neural networks are more productive teachers than human raters: active mixup for data-efficient knowledge distillation from a blackbox model. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 1498–1507 (2020)

    Google Scholar 

  7. Wang, D., Zhang, S., Wang, L.: Deep epidemiological modeling by black-box knowledge distillation: an accurate deep learning model for COVID-19. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 17, pp. 15424–15430 (2021)

    Google Scholar 

  8. Wang, D., Liu, Q., Wu, D., et al.: Meta domain generalization for smart manufacturing: tool wear prediction with small data. J. Manuf. Syst. 62, 441–449 (2022)

    Article  Google Scholar 

  9. Yang, Y., Xing, W., Wang, D., et al.: AEVRNet: adaptive exploration network with variance reduced optimization for visual tracking. Neurocomputing 449, 48–60 (2021)

    Article  Google Scholar 

  10. Wei, X., Wei, X., Kong, X., et al.: FMixCutMatch for semi-supervised deep learning. Neural Netw. 133, 166–176 (2021)

    Article  Google Scholar 

  11. Lu, S., Rao, B.B., Wei, X., et al.: Log-based abnormal task detection and root cause analysis for spark. In: 2017 IEEE International Conference on Web Services (ICWS), pp. 389–396. IEEE (2017)

    Google Scholar 

  12. Lu, S., Wei, X., Rao, B., et al.: LADRA: log-based abnormal task detection and root-cause analysis in big data processing with Spark. Future Gener. Comput. Syst. 95, 392–403 (2019)

    Article  Google Scholar 

  13. Yao, J., Wang, D., Hu, H., Xing, W., Wang, L.: ADCNN: towards learning adaptive dilation for convolutional neural networks. Pattern Recogn. 123, 108369 (2022)

    Article  Google Scholar 

  14. Yao, J., Xing, W., Wang, D., Xing, J., Wang, L.: Active dropblock: method to enhance deep model accuracy and robustness. Neurocomputing 454, 189–200 (2021)

    Article  Google Scholar 

  15. Shi, B., Yang, M., Wang, X., et al.: ASTER: an attentional scene text recognizer with flexible rectification. IEEE Trans. Pattern Anal. Mach. Intell. 41(9), 2035–2048 (2018)

    Article  Google Scholar 

  16. Xu, Y., Wang, Y., Zhou, W., et al.: TextField: learning a deep direction field for irregular scene text detection. IEEE Trans. Image Process. 28(11), 5566–5579 (2019)

    Article  MathSciNet  MATH  Google Scholar 

  17. Kang, Y., Wei, H., Zhang, H., et al.: Woodblock-printing Mongolian words recognition by bi-LSTM with attention mechanism. In: 2019 International Conference on Document Analysis and Recognition (ICDAR), pp. 910–915. IEEE (2019)

    Google Scholar 

  18. Wei, H., Gao, G.: A holistic recognition approach for woodblock-print Mongolian words based on convolutional neural network. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 2726–2730. IEEE (2019)

    Google Scholar 

  19. Kass, D., Vats, E.: AttentionHTR: handwritten text recognition based on attention encoder-decoder networks. arXiv preprint arXiv:2201.09390 (2022)

  20. Mei, J., Dai, L., Shi, B., et al.: Scene text script identification with convolutional recurrent neural networks. In: 2016 23rd International Conference on Pattern Recognition (ICPR), pp. 4053–4058. IEEE (2016)

    Google Scholar 

  21. Shi, B., Bai, X., Yao, C.: An end-to-end trainable neural network for image-based sequence recognition and its application to scene text recognition. IEEE Trans. Pattern Anal. Mach. Intell. 39(11), 2298–2304 (2016)

    Article  Google Scholar 

  22. Graves, A., Fernández, S., Gomez, F., et al.: Connectionist temporal classification: labelling unsegmented sequence data with recurrent neural networks. In: Proceedings of the 23rd International Conference on Machine Learning, pp. 369–376 (2006)

    Google Scholar 

  23. Liao, M., Shi, B., Bai, X., et al.: TextBoxes: a fast text detector with a single deep neural network. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)

    Google Scholar 

  24. Liao, M., Shi, B., Bai, X.: TextBoxes++: a single-shot oriented scene text detector. IEEE Trans. Image Process. 27(8), 3676–3690 (2018)

    Article  MathSciNet  MATH  Google Scholar 

  25. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)

  26. Vaswani, A., Shazeer, N., Parmar, N., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

  27. Jiang, Y., Jiang, Z., He, L., et al.: Text recognition in natural scenes based on deep learning. Multimedia Tools Appl. 81(8), 10545–10559 (2022). https://doi.org/10.1007/s11042-022-12024-w

    Article  Google Scholar 

  28. Cui, S.D., Su, Y.L., Ji, Y.T.: An end-to-end network for irregular printed Mongolian recognition. Int. J. Doc. Anal. Recogn. (IJDAR) 25, 41–50 (2022). https://doi.org/10.1007/s10032-021-00388-y

    Article  Google Scholar 

  29. Zhang, G., Li, J., Wang, A.: A new recognition method for the handwritten Manchu character unit. In: 2006 International Conference on Machine Learning and Cybernetics, pp. 3339–3344. IEEE (2006)

    Google Scholar 

  30. Xu, S., Qi, G.Q., Li, M., et al.: An improved Manchu character recognition method (2016)

    Google Scholar 

  31. Li, M., Zheng, R., Xu, S., et al.: Manchu word recognition based on convolutional neural network with spatial pyramid pooling. In: 2018 11th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI), pp. 1–6. IEEE (2018)

    Google Scholar 

Download references

Acknowledgement

This research was supported by NSF of China (62006016).

Author information

Authors and Affiliations

  1. School of Software Engineering, Beijing Jiaotong University, Beijing, China

    Zhiwei Wang, Mingquan Wang & Xiang Wei

  2. School of Computer and Information Technology, Beijing Jiaotong University, Beijing, China

    Siyang Lu

  3. School of Japanese studies, Dalian University of Foreign Languages, Dalian, China

    Yingjun Qi

Authors
  1. Zhiwei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siyang Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mingquan Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiang Wei
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yingjun Qi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Siyang Lu .

Editor information

Editors and Affiliations

  1. Indian Institute of Technology Indore, Indore, India

    Mohammad Tanveer

  2. Indian Institute of Information Technology - Allahabad, Prayagraj, India

    Sonali Agarwal

  3. Kobe University, Kobe, Japan

    Seiichi Ozawa

  4. Indian Institute of Technology Patna, Patna, India

    Asif Ekbal

  5. University of Innsbruck, Innsbruck, Austria

    Adam Jatowt

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, Z., Lu, S., Wang, M., Wei, X., Qi, Y. (2023). AMRE: An Attention-Based CRNN for Manchu Word Recognition on a Woodblock-Printed Dataset. In: Tanveer, M., Agarwal, S., Ozawa, S., Ekbal, A., Jatowt, A. (eds) Neural Information Processing. ICONIP 2022. Lecture Notes in Computer Science, vol 13624. Springer, Cham. https://doi.org/10.1007/978-3-031-30108-7_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-30108-7_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-30107-0

  • Online ISBN: 978-3-031-30108-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation