Skip to main content

Abstractive Summarization of Social Media Texts as a Tool for Representation of Discussion Dynamics: A Scoping Review

  • Conference paper
  • First Online:
Social Computing and Social Media (HCII 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14025))

Included in the following conference series:

  • 730 Accesses

Abstract

Neural-network-based models of text analysis have been widely implemented for assessment of the dynamics and quality of online discussions, as well as for detection of individual opinions or opinion spectra. Techniques that allow for representing user opinions are being applied in studies of public deliberation, industry-and academe-based marketing studies, and a number of other areas in social research. One of the approaches used more and more in the recent 15 years is summarization, both extractive and abstractive. However, most studies of user opinions tend to treat opinions as finalized extracted/formulated targets, rather than parts of a discussion dynamics where opinions change each other and transform. In accordance with the concept of cumulative deliberation, we see opinion cumulation as a complex process, the dynamic features of which need to be accentuated in literature and more researched upon. In this paper, we review the works that employ abstractive summarization to detect opinions and discussion dynamics in social media data. We show that, despite the availability of already elaborated techniques and models, researchers do not apply them for detecting the dynamics of opinion cumulation and discussion mapping.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mridha, M.F., Lima, A.A., Nur, K., Das, S.C., Hasan, M., Kabir, M.M.: A survey of automatic text summarization: progress, process and challenges. IEEE Access 9, 156043–156070 (2021)

    Article  Google Scholar 

  2. Moussa, M.E., Mohamed, E.H., Haggag, M.H.: A survey on opinion summarization techniques for social media. Future Comput. Inf. J. 3(1), 82–109 (2018)

    Article  Google Scholar 

  3. Kim, H.D., Ganesan, K., Sondhi, P., Zhai, C.: Comprehensive review of opinion summarization (2011). https://www.ideals.illinois.edu/items/18805/bitstreams/67737/stream

  4. Mehta, P.: From extractive to abstractive summarization: a journey. In: ACL (Student Research Workshop), pp. 100–106 (2016)

    Google Scholar 

  5. Gupta, S., Gupta, S.K.: Abstractive summarization: an overview of the state of the art. Expert Syst. Appl. 121, 49–65 (2019)

    Article  Google Scholar 

  6. Bodrunova, S.S., Blekanov, I.S., Maksimov, A.: Public opinion dynamics in online discussions: cumulative commenting and micro-level spirals of silence. In: Meiselwitz, G. (ed.) HCII 2021. LNCS, vol. 12774, pp. 205–220. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77626-8_14

    Chapter  Google Scholar 

  7. Bodrunova, S.S.: Practices of cumulative deliberation: a meta-review of the recent research findings. In: Chugunov, A.V., Janssen, M., Khodachek, I., Misnikov, Y., Trutnev, D. (eds.) EGOSE 2021. CCIS, vol. 1529, pp. 89–104. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-04238-6_8

    Chapter  Google Scholar 

  8. Margetts, H., John, P., Hale, S., Yasseri, T.: Political Turbulence. Princeton University Press (2015)

    Google Scholar 

  9. Habermas, J.: Moral Consciousness and Communicative Action. MIT Press (1990)

    Google Scholar 

  10. Bodrunova, S.S., Nigmatullina, K., Blekanov, I.S., Smoliarova, A., Zhuravleva, N., Danilova, Y.: When emotions grow: cross-cultural differences in the role of emotions in the dynamics of conflictual discussions on social media. In: Meiselwitz, G. (ed.) HCII 2020. LNCS, vol. 12194, pp. 433–441. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49570-1_30

    Chapter  Google Scholar 

  11. Bodrunova, S.S., Blekanov, I.S., Tarasov, N.: Global Agendas: detection of agenda shifts in cross-national discussions using neural-network text summarization for Twitter. In: Meiselwitz, G. (ed.) HCII 2021. LNCS, vol. 12774, pp. 221–239. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77626-8_15

    Chapter  Google Scholar 

  12. Blekanov, I.S., Tarasov, N., Bodrunova, S.S.: Transformer-based abstractive summarization for Reddit and twitter: single posts vs. comment pools three languages. Future Internet 14(3), 69 (2022)

    Google Scholar 

  13. Bodrunova, S.S., Blekanov, I., Smoliarova, A., Litvinenko, A.: Beyond left and right: real-world political polarization in Twitter discussions on inter-ethnic conflicts. Media Commun. 7, 119–132 (2019)

    Article  Google Scholar 

  14. Waisbord, S.: Mob censorship: online harassment of US journalists in times of digital hate and populism. Digit. J. 8(8), 1030–1046 (2020)

    Google Scholar 

  15. Lin, H., Ng, V.: Abstractive summarization: a survey of the state of the art. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 9815–9822 (2019)

    Google Scholar 

  16. Widyassari, A.P., Rustad, S., Shidik, G.F., Noersasongko, E., Syukur, A., Affandy, A.: Review of automatic text summarization techniques & methods. J. King Saud University Comput. Inf. Sci. 34(4), 1029–1046 (2020, 2022)

    Google Scholar 

  17. Wanjale, K., Marathe, P., Patil, V., Lokhande, S., Bhamare, H.: Comprehensive survey on abstractive text summarization. Int. J. Eng. Res. Technol. (IJERT) (2022). ISSN 2278-0181

    Google Scholar 

  18. Syed, A.A., Gaol, F.L., Matsuo, T.: A survey of the state-of-the-art models in neural abstractive text summarization. IEEE Access 9, 13248–13265 (2021)

    Article  Google Scholar 

  19. Alomari, A., Idris, N., Sabri, A.Q.M., Alsmadi, I.: Deep reinforcement and transfer learning for abstractive text summarization: a review. Comput. Speech Lang. 71, 101276 (2022)

    Article  Google Scholar 

  20. Zhang, M., Zhou, G., Yu, W., Huang, N., Liu, W.: A comprehensive survey of abstractive text summarization based on deep learning. Comput. Intell. Neurosci. (2022)

    Google Scholar 

  21. Ma, C., Zhang, W.E., Guo, M., Wang, H., Sheng, Q.Z.: Multi-document summarization via deep learning techniques: a survey. ACM Comput. Surv. 55(5), 1–37 (2022)

    Article  Google Scholar 

  22. Koh, H.Y., Ju, J., Liu, M., Pan, S.: An empirical survey on long document summarization: datasets, models, and metrics. ACM Comput. Surv. 55(8), 1–35 (2022)

    Article  Google Scholar 

  23. Zhao, Z., Chen, P.: To adapt or to fine-tune: a case study on abstractive summarization. In: Chinese Computational Linguistics: 21st China National Conference, CCL 2022, Nanchang, China, 14–16 October 2022, Proceedings, pp. 133–146. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-18315-7_9

  24. Bražinskas, A., Lapata, M., Titov, I.: Few-shot learning for opinion summarization. arXiv preprint arXiv:2004.14884 (2020)

  25. Völske, M., Potthast, M., Syed, S., Stein, B.: TL;DR: mining Reddit to learn automatic summarization. In: Proceedings of the Workshop on New Frontiers in Summarization, pp. 59–63 (2017)

    Google Scholar 

  26. Bommasani, R., Cardie, C.: Intrinsic evaluation of summarization datasets. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 8075–8096 (2020)

    Google Scholar 

  27. Kim, B., Kim, H., Kim, G.: Abstractive summarization of Reddit posts with multi-level memory networks. arXiv preprint arXiv:1811.00783 (2018)

  28. Sotudeh, S., Deilamsalehy, H., Dernoncourt, F., Goharian, N.: TLDR9+: a large scale resource for extreme summarization of social media posts. arXiv preprint arXiv:2110.01159 (2021)

  29. Syed, S., Völske, M., Lipka, N., Stein, B., Schütze, H., Potthast, M.: Towards summarization for social media-results of the TL; DR challenge. In: Proceedings of the 12th International Conference on Natural Language Generation, pp. 523–528 (2019)

    Google Scholar 

  30. Syed, S., Yousef, T., Al-Khatib, K., Jänicke, S., Potthast, M.: Summary explorer: visualizing the state of the art in text summarization. arXiv preprint arXiv:2108.01879 (2021)

  31. Gehrmann, S., Ziegler, Z., Rush, A.M.: Generating abstractive summaries with finetuned language models. In: Proceedings of the 12th International Conference on Natural Language Generation, pp. 516–522 (2019)

    Google Scholar 

  32. Li, L., Liu, W., Litvak, M., Vanetik, N., Huang, Z.: In conclusion not repetition: comprehensive abstractive summarization with diversified attention based on determinantal point processes. arXiv preprint arXiv:1909.10852 (2019)

  33. Choi, H., et al.: VAE-PGN based abstractive model in multi-stage architecture for text summarization. In: Proceedings of the 12th International Conference on Natural Language Generation, pp. 510–515 (2019)

    Google Scholar 

  34. Liu, Y., Jia, Q., Zhu, K.: Keyword-aware abstractive summarization by extracting set-level intermediate summaries. In: Proceedings of the Web Conference 2021, pp. 3042–3054 (2021)

    Google Scholar 

  35. Chen, Y., et al.: CDEvalSumm: an empirical study of cross-dataset evaluation for neural summarization systems. arXiv preprint arXiv:2010.05139 (2020)

  36. Chen, Y.S., Shuai, H.H.: Meta-transfer learning for low-resource abstractive summarization. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 14, pp. 12692–12700 (2021)

    Google Scholar 

  37. Zhang, J., Zhao, Y., Saleh, M., Liu, P.: PEGASUS: pre-training with extracted gap-sentences for abstractive summarization. In: International Conference on Machine Learning, pp. 11328–11339. PMLR (2020)

    Google Scholar 

  38. Liu, S., Yang, L., Cai, X.: SEASum: syntax-enriched abstractive summarization. Expert Syst. Appl. 199, 116819 (2022)

    Article  Google Scholar 

  39. Shi, T., Keneshloo, Y., Ramakrishnan, N., Reddy, C.K.: Neural abstractive text summarization with sequence-to-sequence models. ACM Trans. Data Sci. 2(1), 1–37 (2021)

    Article  Google Scholar 

  40. Bilal, I.M., Wang, B., Tsakalidis, A., Nguyen, D., Procter, R., Liakata, M.: Template-based abstractive microblog opinion summarization. Trans. Assoc. Comput. Linguist. 10, 1229–1248 (2022)

    Article  Google Scholar 

  41. Song, J., Bilal, I.M., Tsakalidis, A., Procter, R., Liakata, M.: Unsupervised opinion summarisation in the wasserstein space. arXiv preprint arXiv:2211.14923 (2022)

  42. Albeer, R.A., Al-Shahad, H.F., Aleqabie, H.J., Al-shakarchy, N.D.: Automatic summarization of YouTube video transcription text using term frequency-inverse document frequency. Indonesian J. Electric. Eng. Comput. Sci. 26(3), 1512–1519 (2022)

    Article  Google Scholar 

  43. Latha, B., Nivedha, B., Ranjanaa, Y.: Visual audio summarization based on NLP models. In: 2022 1st International Conference on Computational Science and Technology (ICCST), pp. 63–66. IEEE (2022)

    Google Scholar 

  44. Vybhavi, A.N.S.S., Saroja, L.V., Duvvuru, J., Bayana, J.: Video transcript summarizer. In: 2022 International Mobile and Embedded Technology Conference (MECON), pp. 461–465. IEEE, March 2022

    Google Scholar 

  45. Xu, W., Miao, Z., Yu, J., Tian, Y., Wan, L., Ji, Q.: Bridging video and text: a two-step polishing transformer for video captioning. IEEE Trans. Circuits Syst. Video Technol. 32(9), 6293–6307 (2022)

    Article  Google Scholar 

  46. Amirian, S., Rasheed, K., Taha, T.R., Arabnia, H.R.: Automatic generation of descriptive titles for video clips using deep learning. In: Arabnia, H.R., Ferens, K., de la Fuente, D., Kozerenko, E.B., Olivas Varela, J.A., Tinetti, F.G. (eds.) Advances in Artificial Intelligence and Applied Cognitive Computing. TCSCI, pp. 17–28. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-70296-0_2

    Chapter  Google Scholar 

  47. Iashin, V., Rahtu, E.: Multi-modal dense video captioning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 958–959 (2020)

    Google Scholar 

  48. Lin, K., et al.: SwinBERT: end-to-end transformers with sparse attention for video captioning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 17949–17958 (2022)

    Google Scholar 

  49. Atri, Y.K., Pramanick, S., Goyal, V., Chakraborty, T.: See, hear, read: leveraging multimodality with guided attention for abstractive text summarization. Knowl.-Based Syst. 227, 107152 (2021)

    Article  Google Scholar 

  50. Narasimhan, M., Rohrbach, A., Darrell, T.: CLIP-it! language-guided video summarization. Adv. Neural. Inf. Process. Syst. 34, 13988–14000 (2021)

    Google Scholar 

  51. Walia, P., Batra, T., Tiwari, S.N., Goel, R.: Abstractive-extractive combined text summarization of Youtube videos. In: International Conference on Innovative Computing and Communications: Proceedings of ICICC 2022, vol. 2, pp. 687–694. Springer, Singapore (2022). https://doi.org/10.1007/978-981-19-2535-1_55

  52. Liang, Z., Du, J., Li, C.: Abstractive social media text summarization using selective reinforced Seq2Seq attention model. Neurocomputing 410, 432–440 (2020)

    Article  Google Scholar 

  53. Wang, Q., Ren, J.: Summary-aware attention for social media short text abstractive summarization. Neurocomputing 425, 290–299 (2021)

    Article  Google Scholar 

  54. Su, M.H., Wu, C.H., Cheng, H.T.: A two-stage transformer-based approach for variable-length abstractive summarization. IEEE/ACM Trans. Audio Speech Lang. Process. 28, 2061–2072 (2020)

    Article  Google Scholar 

  55. Zhang, Z., Liang, X., Zuo, Y., Li, Z.: Unsupervised abstractive summarization via sentence rewriting. Comput. Speech Lang. 78, 101467 (2023)

    Article  Google Scholar 

  56. Zheng, C., Zhang, K., Wang, H.J., Fan, L.: Topic-aware abstractive text summarization. arXiv preprint arXiv:2010.10323 (2020)

  57. Huang, Y., Yu, Z., Guo, J., Xiang, Y., Xian, Y.: Element graph-augmented abstractive summarization for legal public opinion news with graph transformer. Neurocomputing 460, 166–180 (2021)

    Article  Google Scholar 

  58. Gao, S., et al.: Abstractive text summarization by incorporating reader comments. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 6399–6406 (2019)

    Google Scholar 

  59. Bani-Almarjeh, M., Kurdy, M.B.: Arabic abstractive text summarization using RNN-based and transformer-based architectures. Inf. Process. Manage. 60(2), 103227 (2023)

    Article  Google Scholar 

  60. Fouzia, F.A., Rahat, M.A., Alie-Al-Mahdi, Md.T., Masum, A.K.M., Abujar, S., Hossain, S.A.: A Bengali text summarization using encoder-decoder based on social media dataset. In: Hassanien, A.E., Bhattacharyya, S., Chakrabati, S., Bhattacharya, A., Dutta, S. (eds.) Emerging Technologies in Data Mining and Information Security. AISC, vol. 1300, pp. 539–549. Springer, Singapore (2021). https://doi.org/10.1007/978-981-33-4367-2_51

    Chapter  Google Scholar 

  61. Aumiller, D., Fan, J., Gertz, M.: On the state of german (abstractive) text summarization. arXiv preprint arXiv:2301.07095 (2023)

  62. Shafiq, N., Hamid, I., Asif, M., Nawaz, Q., Aljuaid, H., Ali, H.: Abstractive text summarization of low-resourced languages using deep learning. PeerJ Comput. Sci. 9, e1176 (2023)

    Article  Google Scholar 

  63. Babu, G.A., Badugu, S.: Deep learning based sequence to sequence model for abstractive Telugu text summarization. Multimedia Tools Appl., 1–22 (2022)

    Google Scholar 

  64. Louis, A., Maynez, J.: OpineSum: entailment-based self-training for abstractive opinion summarization. arXiv preprint arXiv:2212.10791 (2022)

  65. Bhatnagar, V., Kanojia, D., Chebrolu, K.: Harnessing abstractive summarization for fact-checked claim detection. arXiv preprint arXiv:2209.04612 (2022)

  66. Boorugu, R.; Ramesh, G.: A survey on NLP based text summarization for summarizing product reviews. In: 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), pp. 352–356. IEEE (2020)

    Google Scholar 

  67. Zhang, M., Zhou, G., Huang, N., He, P., Yu, W., Liu, W.: AsU-OSum: aspect-augmented unsupervised opinion summarization. Inf. Process. Manage. 60(1), 103138 (2023)

    Article  Google Scholar 

  68. Han, Y., Nanda, G., Moghaddam, M.: Attribute-sentiment-guided summarization of user opinions from online reviews. J. Mech. Des. 145(4), 041401 (2023)

    Article  Google Scholar 

  69. Li, Q., Li, P., Li, X., Ren, Z., Chen, Z., de Rijke, M.: Abstractive opinion tagging. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 337–345 (2021)

    Google Scholar 

  70. Mane, P., Sonekar, S., Kausar, S.: Development and implementation of tweet stream summarization technique for pernicious tweet detection. In: Iyer, B., Crick, T., Peng, S.L. (eds.) Applied Computational Technologies: Proceedings of ICCET 2022, pp. 477–485. Springer, Singapore (2022). https://doi.org/10.1007/978-981-19-2719-5_45

  71. Sotudeh, S., Goharian, N., Deilamsalehy, H., Dernoncour, F.: Curriculum-guided abstractive summarization for mental health online posts. In: Lavelli, A., Holderness, E., Yepes, A.J., Minard, A.L., Pustejovsky, J., Rinaldi, F.: (eds.) Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (LOUHI), pp. 148–153 (2022). https://doi.org/10.48550/arXiv.2302.00954

  72. Zogan, H., Razzak, I., Jameel, S., Xu, G.: DepressionNet: a novel summarization boosted deep framework for depression detection on social media. arXiv preprint arXiv:2105.10878 (2021)

  73. Tampe, I., Mendoza, M., Milios, E.: Neural abstractive unsupervised summarization of online news discussions. In: Arai, K. (ed.) IntelliSys 2021. LNNS, vol. 295, pp. 822–841. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-82196-8_60

    Chapter  Google Scholar 

  74. Duan, Y., Chen, Z., Wei, F., Zhou, M., Shum, H.Y.: Twitter topic summarization by ranking tweets using social influence and content quality. In: Proceedings of COLING 2012, pp. 763–780 (2012)

    Google Scholar 

  75. He, R., Liu, Y., Yu, G., Tang, J., Hu, Q., Dang, J.: Twitter summarization with social-temporal context. World Wide Web 20(2), 267–290 (2016). https://doi.org/10.1007/s11280-016-0386-0

    Article  Google Scholar 

  76. Rodríguez-Vidal, J., Carrillo-de-Albornoz, J., Amigó, E., Plaza, L., Gonzalo, J., Verdejo, F.: Automatic generation of entity-oriented summaries for reputation management. J. Ambient. Intell. Humaniz. Comput. 11(4), 1577–1591 (2019). https://doi.org/10.1007/s12652-019-01255-9

    Article  Google Scholar 

  77. Blekanov, I.S., Tarasov, N., Bodrunova, S., Sergeev, S.L.: Mapping opinion cumulation: topic modeling-based dynamic summarization of user discussions on social networks. In: Meizelwitz, G. (ed.) Social Computing and Social Media: Experience Design and Social Network Analysis: 15th International Conference, SCSM 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings, Part I. Springer International Publishing (Cham)

    Google Scholar 

Download references

Acknowledgements

This research has been supported in full by Russian Science Foundation, grant 21-18-00454 (2021–2023).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Svetlana S. Bodrunova .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Bodrunova, S.S. (2023). Abstractive Summarization of Social Media Texts as a Tool for Representation of Discussion Dynamics: A Scoping Review. In: Coman, A., Vasilache, S. (eds) Social Computing and Social Media. HCII 2023. Lecture Notes in Computer Science, vol 14025. Springer, Cham. https://doi.org/10.1007/978-3-031-35915-6_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-35915-6_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-35914-9

  • Online ISBN: 978-3-031-35915-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics