Sandra Mitrovic
ABSTRACT
Panic phenomenon is one of the main challenges in the current pandemic time. In this work, we aim to explore the approaches to detect the panic-related COVID-19 tweets. Aligned to this, we propose an unsupervised clustering approach considering negation cues as an extracted feature input to the pre-trained model. This task cannot be done by simply applying state-of-the-art transformer models, since we observed that they occasionally fail in handling negations. Hence, we propose to utilize features based on Contextual Valence Shifters (CVS) along with the pre-trained BERT embeddings. We evaluate and compare the approaches in an unsupervised setup, using standard clustering metrics on a large set of COVID-19 tweets. The obtained results show that CVS effectively facilitates negation handling (positive/negative tweet discrimination).
- Dimo Angelov. 2020. Top2Vec: Distributed Representations of Topics. arXiv preprint arXiv:2008.09470 (2020).Google Scholar
- Floyd E Bloom, Nicholas C Spitzer, Fred Gage, and Tom Albright. 2009. Encyclopedia of Neuroscience, Volume 1. Vol. 1. Academic Press.Google Scholar
- Tadeusz Caliński and Jerzy Harabasz. 1974. A dendrite method for cluster analysis. Communications in Statistics-theory and Methods 3, 1 (1974), 1–27.Google ScholarCross Ref
- Ricardo Campos, Vítor Mangaravite, Arian Pasquali, Alípio Mário Jorge, Célia Nunes, and Adam Jatowt. 2018. Yake! collection-independent automatic keyword extractor. In European Conference on Information Retrieval. Springer, 806–810.Google ScholarCross Ref
- Qingyu Chen, Alexis Allot, and Zhiyong Lu. 2020. LitCovid: an open database of COVID-19 literature. Nucleic Acids Research (2020).Google Scholar
- David L Davies and Donald W Bouldin. 1979. A cluster separation measure. IEEE transactions on pattern analysis and machine intelligence2 (1979), 224–227.Google ScholarDigital Library
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).Google Scholar
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers). 4171–4186.Google Scholar
- Anuja Hariharan, Verena Dorner, Christof Weinhardt, and Georg W Alpers. 2017. Detecting panic potential in social media tweets. (2017).Google Scholar
- Kaggle. 2020. Coronavirus (covid19) Tweets - early April. https://www.kaggle.com/smid80/coronavirus-covid19-tweets-early-april.Google Scholar
- Alistair Kennedy and Diana Inkpen. 2006. Sentiment classification of movie reviews using contextual valence shifters. Computational intelligence 22, 2 (2006), 110–125.Google Scholar
- D Jolene Kinley, Brian J Cox, Ian Clara, Renee D Goodwin, and Jitender Sareen. 2009. Panic attacks and their relation to psychological and physical functioning in Canadians: results from a nationally representative sample. The Canadian Journal of Psychiatry 54, 2 (2009), 113–122.Google ScholarCross Ref
- George A Miller, Richard Beckwith, Christiane Fellbaum, Derek Gross, and Katherine J Miller. 1990. Introduction to WordNet: An on-line lexical database. International journal of lexicography 3, 4 (1990), 235–244.Google ScholarCross Ref
- Sara A Morsy and Ahmed Rafea. 2012. Improving document-level sentiment classification using contextual valence shifters. In International conference on application of natural language to information systems. Springer, 253–258.Google ScholarDigital Library
- Maria Nicola, Zaid Alsafi, Catrin Sohrabi, Ahmed Kerwan, Ahmed Al-Jabir, Christos Iosifidis, Maliha Agha, and Riaz Agha. 2020. The socio-economic implications of the coronavirus and COVID-19 pandemic: a review. International journal of surgery (2020).Google ScholarCross Ref
- Vo Ngoc Phu and Phan Thi Tuoi. 2014. Sentiment classification using enhanced contextual valence shifters. In 2014 International Conference on Asian Language Processing (IALP). IEEE, 224–229.Google ScholarCross Ref
- Livia Polanyi and Annie Zaenen. 2006. Contextual valence shifters. In Computing attitude and affect in text: Theory and applications. Springer, 1–10.Google Scholar
- Peter J Rousseeuw. 1987. Silhouettes: a graphical aid to the interpretation and validation of cluster analysis. Journal of computational and applied mathematics 20 (1987), 53–65.Google ScholarDigital Library
- Xuguang Zhang, Xiaohu Shu, and Zhen He. 2019. Crowd panic state detection using entropy of the distribution of enthalpy. Physica A: Statistical Mechanics and its Applications 525 (2019), 935–945.Google Scholar
Index Terms
- Enhancing BERT Performance with Contextual Valence Shifters for Panic Detection in COVID-19 Tweets
Recommendations
Contextual affect analysis: a system for verification of emotion appropriateness supported with Contextual Valence Shifters
This paper presents a novel method for estimating speaker's affective states based on two contextual features: valence shifters and appropriateness. Firstly, a system for affect analysis is used to recognise specific types of emotions. We improve the ...
Enhancement of SentiWordNet using contextual valence shifters
Sentence structure has a considerable impact on the sentiment polarity of a sentence. In the presence of contextual valence shifters like conjunctions, conditionals and intensifiers some parts of the sentence are more relevant to determine the sentence ...
Wording Matters: the Effect of Linguistic Characteristics and Political Ideology on Resharing of COVID-19 Vaccine Tweets
Social media platforms are frequently used to share information and opinions around vaccinations. The more often a message is reshared, the wider the reach of the message and potential influence it may have on shaping people’s opinions to get vaccinated ...
Comments