Skip to main content
SpringerLink
Log in

Overview of the NLPCC 2023 Shared Task: Chinese Spelling Check

  • Conference paper
  • First Online:
Natural Language Processing and Chinese Computing (NLPCC 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14304))

  • 512 Accesses

Abstract

This paper provides an overview of the Chinese Spelling Check shared task 8, held at NLPCC 2023. The task aims to correct spelling errors in Chinese sentences, including homophonic errors, visually similar errors, and other types of errors found in Chinese news articles. We present the task’s description, previous work related to Chinese Spelling Check, statistics on the provided dataset, evaluation results, and a summary of the submitted approaches. The dataset consists of 1k instances for development and 11k instances for evaluation, collected from publicly available news articles and books. The errors in the dataset were manually identified and labeled. A total of 47 teams registered for the task, with 12 teams submitting their results. The evaluation metric used is the F1 score, with the highest achieved score being 0.5888. The submitted approaches employ various techniques to enhance performance, each focusing on different aspects of the problem. For more information, please visit our official website.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/Arvid-pku/NLPCC2023_Shared_Task8.

  2. 2.

    Please note that the references to external datasets have been hyperlinked for ease of access and reference.

  3. 3.

    https://github.com/BYVoid/OpenCC.

  4. 4.

    https://github.com/Arvid-pku/NLPCC2023_Shared_Task8.

References

  1. Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. arXiv preprint arXiv:1409.0473 (2014)

  2. Cheng, X., et al.: SpellGCN: incorporating phonological and visual similarities into language models for Chinese spelling check. arXiv preprint arXiv:2004.14166 (2020)

  3. Etoori, P., Chinnakotla, M., Mamidi, R.: Automatic spelling correction for resource-scarce languages using deep learning. In: Proceedings of ACL 2018, Student Research Workshop, pp. 146–152 (2018)

    Google Scholar 

  4. Guo, J., Sainath, T.N., Weiss, R.J.: A spelling correction model for end-to-end speech recognition. In: ICASSP 2019–2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5651–5655. IEEE (2019)

    Google Scholar 

  5. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  6. Hong, Y., Yu, X., He, N., Liu, N., Liu, J.: Faspell: a fast, adaptable, simple, powerful Chinese spell checker based on DAE-decoder paradigm. In: Proceedings of the 5th Workshop on Noisy User-generated Text (W-NUT 2019), pp. 160–169 (2019)

    Google Scholar 

  7. Huang, L., et al.: Phmospell: phonological and morphological knowledge guided Chinese spelling check. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers). pp. 5958–5967 (2021)

    Google Scholar 

  8. Ji, T., Yan, H., Qiu, X.: SpellBert: a lightweight pretrained model for Chinese spelling check. In: Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pp. 3544–3551 (2021)

    Google Scholar 

  9. Jia, Z., Wang, P., Zhao, H.: Graph model for Chinese spell checking. In: Proceedings of the Seventh SIGHAN Workshop on Chinese Language Processing, pp. 88–92 (2013)

    Google Scholar 

  10. Kukich, K.: Techniques for automatically correcting words in text. ACM Comput. Surv. (CSUR) 24(4), 377–439 (1992)

    Article  Google Scholar 

  11. Liu, C.L., Lai, M.H., Tien, K.W., Chuang, Y.H., Wu, S.H., Lee, C.Y.: Visually and phonologically similar characters in incorrect Chinese words: analyses, identification, and applications. ACM Trans. Asian Lang. Inf. Process. (TALIP) 10(2), 1–39 (2011)

    Article  Google Scholar 

  12. Liu, S., Yang, T., Yue, T., Zhang, F., Wang, D.: Plome: pre-training with misspelled knowledge for Chinese spelling correction. In: Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 2991–3000 (2021)

    Google Scholar 

  13. Nguyen, M., Ngo, G.H., Chen, N.F.: Domain-shift conditioning using adaptable filtering via hierarchical embeddings for robust Chinese spell check. arXiv preprint arXiv:2008.12281 (2020)

  14. Tseng, Y.H., Lee, L.H., Chang, L.P., Chen, H.H.: Introduction to SIGHAN 2015 bake-off for Chinese spelling check. In: Proceedings of the Eighth SIGHAN Workshop on Chinese Language Processing, pp. 32–37 (2015)

    Google Scholar 

  15. Vaswani, A., et al.: Attention is all you need. In: Advances in neural Information Processing Systems, vol. 30 (2017)

    Google Scholar 

  16. Wang, B., Che, W., Wu, D., Wang, S., Hu, G., Liu, T.: Dynamic connected networks for Chinese spelling check. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 2437–2446 (2021)

    Google Scholar 

  17. Wang, D., Tay, Y., Zhong, L.: Confusionset-guided pointer networks for Chinese spelling check. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 5780–5785 (2019)

    Google Scholar 

  18. Wu, S.H., Liu, C.L., Lee, L.H.: Chinese spelling check evaluation at SIGHAN bake-off 2013. In: SIGHAN@ IJCNLP, pp. 35–42. Citeseer (2013)

    Google Scholar 

  19. Xu, H.D., et al.: Read, listen, and see: leveraging multimodal information helps Chinese spell checking. arXiv preprint arXiv:2105.12306 (2021)

  20. Yin, X., Hu, X., Wan, X.: Chinese spelling check with nearest neighbors (2022)

    Google Scholar 

  21. Yin, X., Wan, X.: A comprehensive evaluation and analysis study for Chinese spelling check (2023)

    Google Scholar 

  22. Yu, L.C., Lee, L.H., Tseng, Y.H., Chen, H.H.: Overview of SIGHAN 2014 bake-off for Chinese spelling check. In: Proceedings of The Third CIPS-SIGHAN Joint Conference on Chinese Language Processing, pp. 126–132 (2014)

    Google Scholar 

  23. Zhang, R., et al.: Correcting Chinese spelling errors with phonetic pre-training. In: Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pp. 2250–2261 (2021)

    Google Scholar 

  24. Zhang, S., Huang, H., Liu, J., Li, H.: Spelling error correction with soft-masked Bert. arXiv preprint arXiv:2005.07421 (2020)

Download references

Author information

Authors and Affiliations

  1. Wangxuan Institute of Computer Technology, Peking University, Beijing, China

    Xunjian Yin & Xiaojun Wan

  2. Center for Data Science, Peking University, Beijing, China

    Xunjian Yin & Xiaojun Wan

  3. The MOE Key Laboratory of Computational Linguistics, Peking University, Beijing, China

    Xunjian Yin & Xiaojun Wan

  4. Beijing Founder Electronics Co., Ltd., Beijing, China

    Dan Zhang, Linlin Yu & Long Yu

Authors
  1. Xunjian Yin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xiaojun Wan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Dan Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Linlin Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Long Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xunjian Yin .

Editor information

Editors and Affiliations

  1. Emory University, Atlanta, GA, USA

    Fei Liu

  2. Microsoft Research Asia, Beijing, China

    Nan Duan

  3. Soochow University, Suzhou, China

    Qingting Xu

  4. Soochow University, Suzhou, China

    Yu Hong

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yin, X., Wan, X., Zhang, D., Yu, L., Yu, L. (2023). Overview of the NLPCC 2023 Shared Task: Chinese Spelling Check. In: Liu, F., Duan, N., Xu, Q., Hong, Y. (eds) Natural Language Processing and Chinese Computing. NLPCC 2023. Lecture Notes in Computer Science(), vol 14304. Springer, Cham. https://doi.org/10.1007/978-3-031-44699-3_30

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-44699-3_30

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-44698-6

  • Online ISBN: 978-3-031-44699-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation