Skip to main content
Log in

Graph attention network based detection of causality for textual emotion-cause pair

  • Published:
World Wide Web Aims and scope Submit manuscript

Abstract

To solve the problem that the existing model cannot adequately express inter-sentence structural information, this paper proposes a textual Emotion-Cause Pair (ECP) causal relationship detection method (GAT-ECP-CD) fused with graph attention network (GAT). A structural relationship graph directly propagates causal features from the context to integrate syntactic dependency information between different sentences in a document. First, using a word-level Bidirectional Long Short-Term Memory (BiLSTM) network to obtain intraclause semantic representations respectively. Then, the independent sentence vector is sent to the GAT as a graph node to capture the local and global dependency information between clauses to obtain richer features. Finally, a multi-task learning module bridges the first and second stages for dynamic prediction. On the benchmark dataset, compared with the existing method, the F1 score is improved by 4.38%, which verifies the effectiveness of the proposed model.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References 

  1. Lee, S.Y.M., Chen, Y., Huang, C.-R.: A text-driven rule-based system for emotion cause detection. In: Inkpen, D., Strapparava, C. (eds.) Proceedings of the NAACL HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text, pp. 45–53. Association for Computational Linguistics, Stroudsburg, PA (2010)

  2. Gao, K., Xu, H., Wang, J.: A rule-based approach to emotion cause detection for Chinese micro-blogs. Expert Systems with Applications 42(9), 4517–4528 (2015)

    Article  Google Scholar 

  3. Gao, K., Xu, H., Wang, J.: Emotion cause detection for Chinese micro-blogs based on ecocc model. In: Cao, T., Lim, E.P., Zhou, Z.H., Ho, T.B., Cheung, D., Motoda, H. (eds.) Advances in Knowledge Discovery and Data Mining (Part II), pp. 3–14. Springer, Cham (2015)

  4. Gui, L., Xu, R., Wu, D., Lu, Q., Zhou, Y.: Event-driven emotion cause extraction with corpus construction. In: Wong, K.-F, Gao, W., Xu, R., Li, W. (eds.) Social Media Content Analysis: Natural Language Processing and Beyond, pp. 145–160. World Scientific Publishing Co. Pte. Ltd., (2018)

  5. Ding, Z., He, H., Zhang, M., Xia, R.: From independent prediction to reordered prediction: Integrating relative position and global label information to emotion cause identification. In: Hentenryck, P.V., Zhou, Z.H. (eds.) Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, pp. 6343–6350. AAAI Press, Palo Alto (2019)

  6. Fan, C., Yan, H., Du, J., Gui, L., Bing, L., Yang, M., Xu, R., Mao, R.: A knowledge regularized hierarchical approach for emotion cause analysis. In: Inui, K., Jiang, J., Ng, V., Wan, X. (eds.) Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 5614–5624. Association for Computational Linguistics, Stroudsburg, PA (2019)

  7. Xia, R., Zhang, M., Ding, Z.: Rthn: A rnn-transformer hierarchical network for emotion cause extraction. https://arxiv.org/abs/1906.01236 (2019). Accessed 1 Mar 2022

  8. Ding, J., Kejriwal, M.: An experimental study of the effects of position bias on emotion causeextraction. https://arxiv.org/abs/2007.15066 (2020). Accessed 1 Mar 2022

  9. Hu, G., Lu, G., Zhao, Y.: Bidirectional hierarchical attention networks based on document-level context for emotion cause extraction. In: Zong, C., Xia, F., Li, W. Navigli, R. (eds.) Findings of the Association for Computational Linguistics: EMNLP 2021, pp. 558–568. Association for Computational Linguistics, Stroudsburg, PA (2021)

  10. Kim, H., Kim, B., Kim, G.: Perspective-taking and pragmatics for generating empathetic responses focused on emotion causes. https://arxiv.org/abs/2109.08828 (2021). Accessed 1 Mar 2022

  11. Li, X., Gao, W., Feng, S., Zhang, Y., Wang, D.: Boundary detection with bert for span-level emotion cause analysis. In: Zong, C., Xia, F., Li, W. Navigli, R. (eds.) Findings of the Association for Computational Linguistics, pp. 676–682. Association for Computational Linguistics, Stroudsburg, PA (2021)

  12. Turcan, E., Wang, S., Anubhai, R., Bhattacharjee, K., Al-Onaizan, Y., Muresan, S.: Multi-task learning and adapted knowledge models for emotion-cause extraction. https://arxiv.org/abs/2106.09790 (2021). Accessed 2 Mar 2022

  13. Yan, H., Gui, L., Pergola, G., He, Y.: Position bias mitigation: A knowledge-aware graph model for emotion cause extraction. https://arxiv.org/abs/2106.03518 (2021). Accessed 2 Mar 2022

  14. Xia, R., Ding, Z.: Emotion-cause pair extraction: A new task to emotion analysis in texts. https://arxiv.org/abs/1906.01267 (2019). Accessed 2 Mar 2022

  15. Ding, Z., Xia, R., Yu, J.: Ecpe-2d: emotion-cause pair extraction based on joint two-dimensional representation, interaction and prediction. In: Jurafsky, D., Chai, J., Schluter, N., Tetreault, J. (eds.) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3161–3170. Association for Computational Linguistics, Stroudsburg, PA (2020)

  16. Ding, Z., Xia, R., Yu, J.: End-to-end emotion-cause pair extraction based on sliding window multi-label learning. In: Webber, B., Cohn, T., He, Y., Liu, Y. (eds.) Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp. 3574–3583. Association for Computational Linguistics, Stroudsburg, PA (2020)

  17. Fan, C., Yuan, C., Du, J., Gui, L., Yang, M., Xu, R.: Transition-based directed graph construction for emotion-cause pair extraction. In: Jurafsky, D., Chai, J., Schluter, N., Tetreault, J. (eds.) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3707–3717. Association for Computational Linguistics, Stroudsburg, PA (2020)

  18. Song, H., Song, D.: An end-to-end multi-task learning to link framework for emotion-cause pair extraction. In: Zhang, Y. (eds.) 2021 International Conference on Image, Video Processing, and Artificial Intelligence, vol. 12076, pp. 13–21. SPIE - International Society for Optics and Photonics (2021)

  19. Wei, P., Zhao, J., Mao, W.: Effective inter-clause modeling for end-to-end emotion-cause pair extraction. In: Jurafsky, D., Chai, J., Schluter, N., Tetreault, J. (eds.) Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 3171–3181. Association for Computational Linguistics, Stroudsburg, PA (2020)

  20. Yuan, C., Fan, C., Bao, J., Xu, R.: Emotion-cause pair extraction as sequence labeling based on a novel tagging scheme. In: Webber, B., Cohn, T., He, Y., Liu, Y. (eds.) Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing, pp. 3568–3573. Association for Computational Linguistics, Stroudsburg, PA (2020)

  21. Chen, Y., Hou, W., Li, S., Wu, C., Zhang, X.: End-to-end emotion-cause pair extraction with graph convolutional network. In: Scott, D., Bel, N., Zong, C. (eds.) Proceedings of the 28th International Conference on Computational Linguistics, pp. 198–207. International Committee on Computational Linguistics (2020)

  22. Wang, F., Ding, Z., Xia, R., Li, Z., Yu, J.: Multimodal emotion-cause pair extraction in conversations. https://arxiv.org/abs/2110.08020. Accessed 3 Mar 2022

  23. Chen, X., Li, Q., Wang, J.: Conditional causal relationships between emotions and causes in texts. In: Webber, B., Cohn, T., He, Y., Liu, Y. (eds.) Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 3111–3121. Association for Computational Linguistics, Stroudsburg, PA (2020)

  24. Mirza, P., Tonelli, S.: An analysis of causality between events and its relation to temporal information. In: Tsujii, J., Hajic, J. (Eds.) Proceedings of the 25th International Conference on Computational Linguistics: Technical Papers, pp. 2097–2106. Dublin City University and Association for Computational Linguistics (2014)

  25. Ning, Q., Feng, Z., Wu, H., Roth, D.: Joint reasoning for temporal and causal relations. https://arxiv.org/abs/1906.04941. Accessed 3 Mar 2022

  26. Zhang, B., Su, J., Xiong, D., Lu, Y., Duan, H., Yao, J.: Shallow convolutional neural network for implicit discourse relation recognition. In: Márquez, L., Callison-Burch, C., Su, J. (Eds.) Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp. 2230–2235. Association for Computational Linguistics, Stroudsburg, PA (2015)

  27. Kadowaki, K., Iida, R., Torisawa, K., Oh, J.-H., Kloetzer, J.: Event causality recognition exploiting multiple annotators’ judgments and background knowledge. In: Inui, K., Jiang, J., Ng, V., Wan, X. (eds.) Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, pp. 5816–5822 (2019)

  28. Zhao, K., Ji, D., He, F., Liu, Y., Ren, Y.: Document-level event causality identification via graph inference mechanism. Information Sciences 561, 115–129 (2021)

    Article  MathSciNet  Google Scholar 

  29. Liu, J., Chen, Y., Zhao, J.: Knowledge enhanced event causality identification with mention masking generalizations. In: Bessière, C. (eds.) Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence, pp. 3608–3614. International Joint Conferences on Artificial Intelligence (2020)

  30. Cao, P., Zuo, X., Chen, Y., Liu, K., Zhao, J., Chen, Y., Peng, W.: Knowledge-enriched event causality identification via latent structure induction networks. In: Zong, C., Xia, F., Li, W. Navigli, R. (eds.) Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pp. 4862–4872. Association for Computational Linguistics, Stroudsburg, PA (2021)

  31. Zuo, X., Chen, Y., Liu, K., Zhao, J.: Knowdis: Knowledge enhanced data augmentation for event causality detection via distant supervision. https://arxiv.org/abs/2010.10833 (2020). Accessed 3 Mar 2022

  32. Zuo, X., Cao, P., Chen, Y., Liu, K., Zhao, J., Peng, W., Chen, Y.: Learnda: Learnable knowledge-guided data augmentation for event causality identification. https://arxiv.org/abs/2106.01649 (2021). Accessed 3 Mar 2022

  33. Zheng, B., Jiang, Q., Lu, B., He, K., Wu, M.-N., Hao, X.-L., Zhou, H.-X., Zhu, S.-J., Yang, W.-H.: Five-category intelligent auxiliary diagnosis model of common fundus diseases based on fundus images. Translational Vision Science & Technology 10(7), 1–10 (2021)

    Article  Google Scholar 

  34. Zheng, B., Liu, Y., He, K., Wu, M., Jin, L., Jiang, Q., Zhu, S., Hao, X., Wang, C., Yang, W.: Research on an intelligent lightweight-assisted pterygium diagnosis model based on anterior segment images. Disease Markers 2021, 7651462 (2021)

    Article  Google Scholar 

  35. Zhu, S., Lu, B., Wang, C., Wu, M., Zheng, B., Jiang, Q., Wei, R., Cao, Q., Yang, W.: Screening of common retinal diseases using six-category models based on efficientnet. Front. Med. 9:808402 (2022)

  36. Defferrard, M., Bresson, X., Vandergheynst, P.: Convolutional neural networks on graphs with fast localized spectral filtering. In: Lee, D.D., Luxburg, U., Garnett, R., Sugiyama, M., Guyon, I. (eds.) Proceedings of 30th Conference on Neural Information Processing Systems (NIPS 2016), pp. 1–9. Curran Associates Inc. (2016)

  37. Niepert, M., Ahmed, M., Kutzkov, K.: Learning convolutional neural networks for graphs. In: Balcan, M., Weinberger, K. (eds.) Proceedings of The 33rd International Conference on Machine Learning, pp. 2014–2023. PMLR (2016)

  38. Hamilton, W., Ying, Z., Leskovec, J.: Inductive representation learning on large graphs. In: Luxburg, U., Guyon, I., Bengio, S., Wallach, H., Fergu, R. (eds.) Proceedings of 31st Conference on Neural Information Processing Systems (NIPS 2017), pp. 1–11. Curran Associates Inc. (2017)

  39. Velickovic, P., Cucurull, G., Casanova, A., Romero, A., Lio, P., Bengio, Y.: Graph attention networks. Stat 1050, 20 (2017)

    Google Scholar 

  40. He, F., Liu, T., Tao, D.: Control batch size and learning rate to generalize well: Theoretical and empirical evidence. In: Wallach, H., Larochelle, H., Beygelzimer, A., d'Alché-Buc, F., Fox, E., Garnett, R. (eds.) Proceedings of 33rd Conference on Neural Information Processing Systems (NeurIPS 2019), pp. 1–10. Curran Associates, Inc. (2020)

  41. Liu, M., Gao, H., Ji, S.: Towards deeper graph neural networks. In: Rajesh Gupta, R., Liu, Y., Shah, M., Rajan, S., Tang, J., Prakash, B.A. (eds.) Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 338–348. ACM (2020)

Download references

Acknowledgements

This work was partially supported by Postgraduates’ Scientific Research and Innovation Project of Huzhou University under Grant 2020KYCX24 and Zhejiang Province Key Laboratory of Smart Management & Application of Modern Agricultural Resources under Grant 2020E10017.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xiulan Hao.

Ethics declarations

Conflicts of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Qian Cao and Xiulan Hao contributed equally to this work.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cao, Q., Hao, X., Ren, H. et al. Graph attention network based detection of causality for textual emotion-cause pair. World Wide Web 26, 1731–1745 (2023). https://doi.org/10.1007/s11280-022-01111-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11280-022-01111-5

Keywords

Navigation