Skip to main content
SpringerLink
Log in

Overview of the NLPCC 2023 Shared Task: Chinese Essay Discourse Coherence Evaluation

  • Conference paper
  • First Online:
Natural Language Processing and Chinese Computing (NLPCC 2023)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 14304))

  • 522 Accesses

Abstract

In this paper, we present an overview of the Chinese Essay Discourse Coherence Evaluation task in the NLPCC 2023 shared tasks. We give detailed descriptions of the task definition and the data for training as well as evaluation. We also summarize the approaches investigated by the participants of this task. Such approaches demonstrate the state-of-the-art of discourse coherence evaluation for Chinese essay. The data set and evaluation tool used by this task is available at https://github.com/cubenlp/NLPCC-2023-Shared-Task7.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://github.com/cubenlp/NLPCC-2023-Shared-Task7/blob/main.

  2. 2.

    https://huggingface.co/hfl/chinese-roberta-wwm-ext.

References

  1. Devlin, J., Chang, M., Lee, K., Toutanova, K.: BERT: pre-training of deep bidirectional transformers for language understanding. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2–7, 2019, Volume 1 (Long and Short Papers), pp. 4171–4186. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/n19-1423

  2. Farag, Y., Yannakoudakis, H., Briscoe, T.: Neural automated essay scoring and coherence modeling for adversarially crafted input. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 263–271. Association for Computational Linguistics, New Orleans, Louisiana (2018). https://doi.org/10.18653/v1/N18-1024, aclanthology.org/N18-1024

  3. Flansmose Mikkelsen, L., Kinch, O., Jess Pedersen, A., Lacroix, O.: DDisCo: a discourse coherence dataset for Danish. In: Proceedings of the Thirteenth Language Resources and Evaluation Conference, pp. 2440–2445. European Language Resources Association, Marseille, France (2022). http://aclanthology.org/2022.lrec-1.260

  4. Guan, J., Mao, X., Fan, C., Liu, Z., Ding, W., Huang, M.: Long text generation by modeling sentence-level and discourse-level coherence. In: Zong, C., Xia, F., Li, W., Navigli, R. (eds.) Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing, ACL/IJCNLP 2021, (Volume 1: Long Papers), Virtual Event, August 1–6, 2021. pp. 6379–6393. Association for Computational Linguistics (2021). https://doi.org/10.18653/v1/2021.acl-long.499

  5. Lai, A., Tetreault, J.: Discourse coherence in the wild: a dataset, evaluation and methods. In: Proceedings of the 19th Annual SIGdial Meeting on Discourse and Dialogue, pp. 214–223. Association for Computational Linguistics, Melbourne, Australia (2018). https://doi.org/10.18653/v1/W18-5023, http://aclanthology.org/W18-5023

  6. Lin, Z., Ng, H.T., Kan, M.: Automatically evaluating text coherence using discourse relations. In: Lin, D., Matsumoto, Y., Mihalcea, R. (eds.) The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference, 19–24 June, 2011, Portland, Oregon, USA, pp. 997–1006. The Association for Computer Linguistics (2011), aclanthology.org/P11-1100/

    Google Scholar 

  7. Long, W., Webber, B., Xiong, D.: TED-CDB: a large-scale Chinese discourse relation dataset on TED talks. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 2793–2803. Association for Computational Linguistics, Online (2020). https://doi.org/10.18653/v1/2020.emnlp-main.223, aclanthology.org/2020.emnlp-main.223

  8. Lu, Y., et al.: Unified structure generation for universal information extraction. In: Muresan, S., Nakov, P., Villavicencio, A. (eds.) Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), ACL 2022, Dublin, Ireland, May 22–27, 2022, pp. 5755–5772. Association for Computational Linguistics (2022). https://doi.org/10.18653/v1/2022.acl-long.395

  9. Shrivastava, D., Mishra, A., Sankaranarayanan, K.: Modeling topical coherence in discourse without supervision. CoRR abs/1809.00410 (2018). arxiv.org/abs/1809.00410

  10. Sileo, D., de Cruys, T.V., Pradel, C., Muller, P.: Mining discourse markers for unsupervised sentence representation learning. In: Burstein, J., Doran, C., Solorio, T. (eds.) Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, NAACL-HLT 2019, Minneapolis, MN, USA, June 2–7, 2019, Volume 1 (Long and Short Papers), pp. 3477–3486. Association for Computational Linguistics (2019). https://doi.org/10.18653/v1/n19-1351

  11. Xiong, H., He, Z., Wu, H., Wang, H.: Modeling coherence for discourse neural machine translation. In: The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, The Thirty-First Innovative Applications of Artificial Intelligence Conference, IAAI 2019, The Ninth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2019, Honolulu, Hawaii, USA, January 27 - February 1, 2019, pp. 7338–7345. AAAI Press (2019). https://doi.org/10.1609/aaai.v33i01.33017338

Download references

Acknowledgements

We appreciate the support from National Natural Science Foundation of China with the Main Research Project on Machine Behavior and Human Machine Collaborated Decision Making Methodology (72192820 & 72192824), Pudong New Area Science & Technology Development Fund (PKX2021-R05), Science and Technology Commission of Shanghai Municipality (22DZ2229004) and Shanghai Trusted Industry Internet Software Collaborative Innovation Center.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, East China Normal University, Shanghai, China

    Hongyi Wu, Xinshu Shen, Man Lan, Yuanbin Wu & Aimin Zhou

  2. Shanghai Institute of AI for Education, East China Normal University, Shanghai, China

    Man Lan, Yuanbin Wu & Aimin Zhou

  3. Department of Chinese Language and Literature, East China Normal University, Shanghai, China

    Xiaopeng Bai

  4. Microsoft Research Asia, Beijing, China

    Shaoguang Mao, Tao Ge & Yan Xia

Authors
  1. Hongyi Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xinshu Shen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Man Lan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xiaopeng Bai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Yuanbin Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Aimin Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Shaoguang Mao
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Tao Ge
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Yan Xia
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Hongyi Wu or Man Lan .

Editor information

Editors and Affiliations

  1. Emory University, Atlanta, GA, USA

    Fei Liu

  2. Microsoft Research Asia, Beijing, China

    Nan Duan

  3. Soochow University, Suzhou, China

    Qingting Xu

  4. Soochow University, Suzhou, China

    Yu Hong

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wu, H. et al. (2023). Overview of the NLPCC 2023 Shared Task: Chinese Essay Discourse Coherence Evaluation. In: Liu, F., Duan, N., Xu, Q., Hong, Y. (eds) Natural Language Processing and Chinese Computing. NLPCC 2023. Lecture Notes in Computer Science(), vol 14304. Springer, Cham. https://doi.org/10.1007/978-3-031-44699-3_26

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-44699-3_26

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-44698-6

  • Online ISBN: 978-3-031-44699-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation