Abstract
Neural-network-based models of text analysis have been widely implemented for assessment of the dynamics and quality of online discussions, as well as for detection of individual opinions or opinion spectra. Techniques that allow for representing user opinions are being applied in studies of public deliberation, industry-and academe-based marketing studies, and a number of other areas in social research. One of the approaches used more and more in the recent 15 years is summarization, both extractive and abstractive. However, most studies of user opinions tend to treat opinions as finalized extracted/formulated targets, rather than parts of a discussion dynamics where opinions change each other and transform. In accordance with the concept of cumulative deliberation, we see opinion cumulation as a complex process, the dynamic features of which need to be accentuated in literature and more researched upon. In this paper, we review the works that employ abstractive summarization to detect opinions and discussion dynamics in social media data. We show that, despite the availability of already elaborated techniques and models, researchers do not apply them for detecting the dynamics of opinion cumulation and discussion mapping.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mridha, M.F., Lima, A.A., Nur, K., Das, S.C., Hasan, M., Kabir, M.M.: A survey of automatic text summarization: progress, process and challenges. IEEE Access 9, 156043–156070 (2021)
Moussa, M.E., Mohamed, E.H., Haggag, M.H.: A survey on opinion summarization techniques for social media. Future Comput. Inf. J. 3(1), 82–109 (2018)
Kim, H.D., Ganesan, K., Sondhi, P., Zhai, C.: Comprehensive review of opinion summarization (2011). https://www.ideals.illinois.edu/items/18805/bitstreams/67737/stream
Mehta, P.: From extractive to abstractive summarization: a journey. In: ACL (Student Research Workshop), pp. 100–106 (2016)
Gupta, S., Gupta, S.K.: Abstractive summarization: an overview of the state of the art. Expert Syst. Appl. 121, 49–65 (2019)
Bodrunova, S.S., Blekanov, I.S., Maksimov, A.: Public opinion dynamics in online discussions: cumulative commenting and micro-level spirals of silence. In: Meiselwitz, G. (ed.) HCII 2021. LNCS, vol. 12774, pp. 205–220. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77626-8_14
Bodrunova, S.S.: Practices of cumulative deliberation: a meta-review of the recent research findings. In: Chugunov, A.V., Janssen, M., Khodachek, I., Misnikov, Y., Trutnev, D. (eds.) EGOSE 2021. CCIS, vol. 1529, pp. 89–104. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-04238-6_8
Margetts, H., John, P., Hale, S., Yasseri, T.: Political Turbulence. Princeton University Press (2015)
Habermas, J.: Moral Consciousness and Communicative Action. MIT Press (1990)
Bodrunova, S.S., Nigmatullina, K., Blekanov, I.S., Smoliarova, A., Zhuravleva, N., Danilova, Y.: When emotions grow: cross-cultural differences in the role of emotions in the dynamics of conflictual discussions on social media. In: Meiselwitz, G. (ed.) HCII 2020. LNCS, vol. 12194, pp. 433–441. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-49570-1_30
Bodrunova, S.S., Blekanov, I.S., Tarasov, N.: Global Agendas: detection of agenda shifts in cross-national discussions using neural-network text summarization for Twitter. In: Meiselwitz, G. (ed.) HCII 2021. LNCS, vol. 12774, pp. 221–239. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-77626-8_15
Blekanov, I.S., Tarasov, N., Bodrunova, S.S.: Transformer-based abstractive summarization for Reddit and twitter: single posts vs. comment pools three languages. Future Internet 14(3), 69 (2022)
Bodrunova, S.S., Blekanov, I., Smoliarova, A., Litvinenko, A.: Beyond left and right: real-world political polarization in Twitter discussions on inter-ethnic conflicts. Media Commun. 7, 119–132 (2019)
Waisbord, S.: Mob censorship: online harassment of US journalists in times of digital hate and populism. Digit. J. 8(8), 1030–1046 (2020)
Lin, H., Ng, V.: Abstractive summarization: a survey of the state of the art. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 9815–9822 (2019)
Widyassari, A.P., Rustad, S., Shidik, G.F., Noersasongko, E., Syukur, A., Affandy, A.: Review of automatic text summarization techniques & methods. J. King Saud University Comput. Inf. Sci. 34(4), 1029–1046 (2020, 2022)
Wanjale, K., Marathe, P., Patil, V., Lokhande, S., Bhamare, H.: Comprehensive survey on abstractive text summarization. Int. J. Eng. Res. Technol. (IJERT) (2022). ISSN 2278-0181
Syed, A.A., Gaol, F.L., Matsuo, T.: A survey of the state-of-the-art models in neural abstractive text summarization. IEEE Access 9, 13248–13265 (2021)
Alomari, A., Idris, N., Sabri, A.Q.M., Alsmadi, I.: Deep reinforcement and transfer learning for abstractive text summarization: a review. Comput. Speech Lang. 71, 101276 (2022)
Zhang, M., Zhou, G., Yu, W., Huang, N., Liu, W.: A comprehensive survey of abstractive text summarization based on deep learning. Comput. Intell. Neurosci. (2022)
Ma, C., Zhang, W.E., Guo, M., Wang, H., Sheng, Q.Z.: Multi-document summarization via deep learning techniques: a survey. ACM Comput. Surv. 55(5), 1–37 (2022)
Koh, H.Y., Ju, J., Liu, M., Pan, S.: An empirical survey on long document summarization: datasets, models, and metrics. ACM Comput. Surv. 55(8), 1–35 (2022)
Zhao, Z., Chen, P.: To adapt or to fine-tune: a case study on abstractive summarization. In: Chinese Computational Linguistics: 21st China National Conference, CCL 2022, Nanchang, China, 14–16 October 2022, Proceedings, pp. 133–146. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-18315-7_9
Bražinskas, A., Lapata, M., Titov, I.: Few-shot learning for opinion summarization. arXiv preprint arXiv:2004.14884 (2020)
Völske, M., Potthast, M., Syed, S., Stein, B.: TL;DR: mining Reddit to learn automatic summarization. In: Proceedings of the Workshop on New Frontiers in Summarization, pp. 59–63 (2017)
Bommasani, R., Cardie, C.: Intrinsic evaluation of summarization datasets. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 8075–8096 (2020)
Kim, B., Kim, H., Kim, G.: Abstractive summarization of Reddit posts with multi-level memory networks. arXiv preprint arXiv:1811.00783 (2018)
Sotudeh, S., Deilamsalehy, H., Dernoncourt, F., Goharian, N.: TLDR9+: a large scale resource for extreme summarization of social media posts. arXiv preprint arXiv:2110.01159 (2021)
Syed, S., Völske, M., Lipka, N., Stein, B., Schütze, H., Potthast, M.: Towards summarization for social media-results of the TL; DR challenge. In: Proceedings of the 12th International Conference on Natural Language Generation, pp. 523–528 (2019)
Syed, S., Yousef, T., Al-Khatib, K., Jänicke, S., Potthast, M.: Summary explorer: visualizing the state of the art in text summarization. arXiv preprint arXiv:2108.01879 (2021)
Gehrmann, S., Ziegler, Z., Rush, A.M.: Generating abstractive summaries with finetuned language models. In: Proceedings of the 12th International Conference on Natural Language Generation, pp. 516–522 (2019)
Li, L., Liu, W., Litvak, M., Vanetik, N., Huang, Z.: In conclusion not repetition: comprehensive abstractive summarization with diversified attention based on determinantal point processes. arXiv preprint arXiv:1909.10852 (2019)
Choi, H., et al.: VAE-PGN based abstractive model in multi-stage architecture for text summarization. In: Proceedings of the 12th International Conference on Natural Language Generation, pp. 510–515 (2019)
Liu, Y., Jia, Q., Zhu, K.: Keyword-aware abstractive summarization by extracting set-level intermediate summaries. In: Proceedings of the Web Conference 2021, pp. 3042–3054 (2021)
Chen, Y., et al.: CDEvalSumm: an empirical study of cross-dataset evaluation for neural summarization systems. arXiv preprint arXiv:2010.05139 (2020)
Chen, Y.S., Shuai, H.H.: Meta-transfer learning for low-resource abstractive summarization. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 35, no. 14, pp. 12692–12700 (2021)
Zhang, J., Zhao, Y., Saleh, M., Liu, P.: PEGASUS: pre-training with extracted gap-sentences for abstractive summarization. In: International Conference on Machine Learning, pp. 11328–11339. PMLR (2020)
Liu, S., Yang, L., Cai, X.: SEASum: syntax-enriched abstractive summarization. Expert Syst. Appl. 199, 116819 (2022)
Shi, T., Keneshloo, Y., Ramakrishnan, N., Reddy, C.K.: Neural abstractive text summarization with sequence-to-sequence models. ACM Trans. Data Sci. 2(1), 1–37 (2021)
Bilal, I.M., Wang, B., Tsakalidis, A., Nguyen, D., Procter, R., Liakata, M.: Template-based abstractive microblog opinion summarization. Trans. Assoc. Comput. Linguist. 10, 1229–1248 (2022)
Song, J., Bilal, I.M., Tsakalidis, A., Procter, R., Liakata, M.: Unsupervised opinion summarisation in the wasserstein space. arXiv preprint arXiv:2211.14923 (2022)
Albeer, R.A., Al-Shahad, H.F., Aleqabie, H.J., Al-shakarchy, N.D.: Automatic summarization of YouTube video transcription text using term frequency-inverse document frequency. Indonesian J. Electric. Eng. Comput. Sci. 26(3), 1512–1519 (2022)
Latha, B., Nivedha, B., Ranjanaa, Y.: Visual audio summarization based on NLP models. In: 2022 1st International Conference on Computational Science and Technology (ICCST), pp. 63–66. IEEE (2022)
Vybhavi, A.N.S.S., Saroja, L.V., Duvvuru, J., Bayana, J.: Video transcript summarizer. In: 2022 International Mobile and Embedded Technology Conference (MECON), pp. 461–465. IEEE, March 2022
Xu, W., Miao, Z., Yu, J., Tian, Y., Wan, L., Ji, Q.: Bridging video and text: a two-step polishing transformer for video captioning. IEEE Trans. Circuits Syst. Video Technol. 32(9), 6293–6307 (2022)
Amirian, S., Rasheed, K., Taha, T.R., Arabnia, H.R.: Automatic generation of descriptive titles for video clips using deep learning. In: Arabnia, H.R., Ferens, K., de la Fuente, D., Kozerenko, E.B., Olivas Varela, J.A., Tinetti, F.G. (eds.) Advances in Artificial Intelligence and Applied Cognitive Computing. TCSCI, pp. 17–28. Springer, Cham (2021). https://doi.org/10.1007/978-3-030-70296-0_2
Iashin, V., Rahtu, E.: Multi-modal dense video captioning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 958–959 (2020)
Lin, K., et al.: SwinBERT: end-to-end transformers with sparse attention for video captioning. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 17949–17958 (2022)
Atri, Y.K., Pramanick, S., Goyal, V., Chakraborty, T.: See, hear, read: leveraging multimodality with guided attention for abstractive text summarization. Knowl.-Based Syst. 227, 107152 (2021)
Narasimhan, M., Rohrbach, A., Darrell, T.: CLIP-it! language-guided video summarization. Adv. Neural. Inf. Process. Syst. 34, 13988–14000 (2021)
Walia, P., Batra, T., Tiwari, S.N., Goel, R.: Abstractive-extractive combined text summarization of Youtube videos. In: International Conference on Innovative Computing and Communications: Proceedings of ICICC 2022, vol. 2, pp. 687–694. Springer, Singapore (2022). https://doi.org/10.1007/978-981-19-2535-1_55
Liang, Z., Du, J., Li, C.: Abstractive social media text summarization using selective reinforced Seq2Seq attention model. Neurocomputing 410, 432–440 (2020)
Wang, Q., Ren, J.: Summary-aware attention for social media short text abstractive summarization. Neurocomputing 425, 290–299 (2021)
Su, M.H., Wu, C.H., Cheng, H.T.: A two-stage transformer-based approach for variable-length abstractive summarization. IEEE/ACM Trans. Audio Speech Lang. Process. 28, 2061–2072 (2020)
Zhang, Z., Liang, X., Zuo, Y., Li, Z.: Unsupervised abstractive summarization via sentence rewriting. Comput. Speech Lang. 78, 101467 (2023)
Zheng, C., Zhang, K., Wang, H.J., Fan, L.: Topic-aware abstractive text summarization. arXiv preprint arXiv:2010.10323 (2020)
Huang, Y., Yu, Z., Guo, J., Xiang, Y., Xian, Y.: Element graph-augmented abstractive summarization for legal public opinion news with graph transformer. Neurocomputing 460, 166–180 (2021)
Gao, S., et al.: Abstractive text summarization by incorporating reader comments. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 6399–6406 (2019)
Bani-Almarjeh, M., Kurdy, M.B.: Arabic abstractive text summarization using RNN-based and transformer-based architectures. Inf. Process. Manage. 60(2), 103227 (2023)
Fouzia, F.A., Rahat, M.A., Alie-Al-Mahdi, Md.T., Masum, A.K.M., Abujar, S., Hossain, S.A.: A Bengali text summarization using encoder-decoder based on social media dataset. In: Hassanien, A.E., Bhattacharyya, S., Chakrabati, S., Bhattacharya, A., Dutta, S. (eds.) Emerging Technologies in Data Mining and Information Security. AISC, vol. 1300, pp. 539–549. Springer, Singapore (2021). https://doi.org/10.1007/978-981-33-4367-2_51
Aumiller, D., Fan, J., Gertz, M.: On the state of german (abstractive) text summarization. arXiv preprint arXiv:2301.07095 (2023)
Shafiq, N., Hamid, I., Asif, M., Nawaz, Q., Aljuaid, H., Ali, H.: Abstractive text summarization of low-resourced languages using deep learning. PeerJ Comput. Sci. 9, e1176 (2023)
Babu, G.A., Badugu, S.: Deep learning based sequence to sequence model for abstractive Telugu text summarization. Multimedia Tools Appl., 1–22 (2022)
Louis, A., Maynez, J.: OpineSum: entailment-based self-training for abstractive opinion summarization. arXiv preprint arXiv:2212.10791 (2022)
Bhatnagar, V., Kanojia, D., Chebrolu, K.: Harnessing abstractive summarization for fact-checked claim detection. arXiv preprint arXiv:2209.04612 (2022)
Boorugu, R.; Ramesh, G.: A survey on NLP based text summarization for summarizing product reviews. In: 2020 Second International Conference on Inventive Research in Computing Applications (ICIRCA), pp. 352–356. IEEE (2020)
Zhang, M., Zhou, G., Huang, N., He, P., Yu, W., Liu, W.: AsU-OSum: aspect-augmented unsupervised opinion summarization. Inf. Process. Manage. 60(1), 103138 (2023)
Han, Y., Nanda, G., Moghaddam, M.: Attribute-sentiment-guided summarization of user opinions from online reviews. J. Mech. Des. 145(4), 041401 (2023)
Li, Q., Li, P., Li, X., Ren, Z., Chen, Z., de Rijke, M.: Abstractive opinion tagging. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining, pp. 337–345 (2021)
Mane, P., Sonekar, S., Kausar, S.: Development and implementation of tweet stream summarization technique for pernicious tweet detection. In: Iyer, B., Crick, T., Peng, S.L. (eds.) Applied Computational Technologies: Proceedings of ICCET 2022, pp. 477–485. Springer, Singapore (2022). https://doi.org/10.1007/978-981-19-2719-5_45
Sotudeh, S., Goharian, N., Deilamsalehy, H., Dernoncour, F.: Curriculum-guided abstractive summarization for mental health online posts. In: Lavelli, A., Holderness, E., Yepes, A.J., Minard, A.L., Pustejovsky, J., Rinaldi, F.: (eds.) Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (LOUHI), pp. 148–153 (2022). https://doi.org/10.48550/arXiv.2302.00954
Zogan, H., Razzak, I., Jameel, S., Xu, G.: DepressionNet: a novel summarization boosted deep framework for depression detection on social media. arXiv preprint arXiv:2105.10878 (2021)
Tampe, I., Mendoza, M., Milios, E.: Neural abstractive unsupervised summarization of online news discussions. In: Arai, K. (ed.) IntelliSys 2021. LNNS, vol. 295, pp. 822–841. Springer, Cham (2022). https://doi.org/10.1007/978-3-030-82196-8_60
Duan, Y., Chen, Z., Wei, F., Zhou, M., Shum, H.Y.: Twitter topic summarization by ranking tweets using social influence and content quality. In: Proceedings of COLING 2012, pp. 763–780 (2012)
He, R., Liu, Y., Yu, G., Tang, J., Hu, Q., Dang, J.: Twitter summarization with social-temporal context. World Wide Web 20(2), 267–290 (2016). https://doi.org/10.1007/s11280-016-0386-0
Rodríguez-Vidal, J., Carrillo-de-Albornoz, J., Amigó, E., Plaza, L., Gonzalo, J., Verdejo, F.: Automatic generation of entity-oriented summaries for reputation management. J. Ambient. Intell. Humaniz. Comput. 11(4), 1577–1591 (2019). https://doi.org/10.1007/s12652-019-01255-9
Blekanov, I.S., Tarasov, N., Bodrunova, S., Sergeev, S.L.: Mapping opinion cumulation: topic modeling-based dynamic summarization of user discussions on social networks. In: Meizelwitz, G. (ed.) Social Computing and Social Media: Experience Design and Social Network Analysis: 15th International Conference, SCSM 2023, Held as Part of the 25th HCI International Conference, HCII 2023, Copenhagen, Denmark, July 23–28, 2023, Proceedings, Part I. Springer International Publishing (Cham)
Acknowledgements
This research has been supported in full by Russian Science Foundation, grant 21-18-00454 (2021–2023).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Bodrunova, S.S. (2023). Abstractive Summarization of Social Media Texts as a Tool for Representation of Discussion Dynamics: A Scoping Review. In: Coman, A., Vasilache, S. (eds) Social Computing and Social Media. HCII 2023. Lecture Notes in Computer Science, vol 14025. Springer, Cham. https://doi.org/10.1007/978-3-031-35915-6_4
Download citation
DOI: https://doi.org/10.1007/978-3-031-35915-6_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-35914-9
Online ISBN: 978-3-031-35915-6
eBook Packages: Computer ScienceComputer Science (R0)