Abstract
In the pandemic COVID-19 situation, the world is facing a pandemic of fake information which often stirs the public attention by attacking their emotional quotient. Scenario reached a situation where people in search of worthy information for public health and precaution, getting fake news. This unprecedented expansion of fake information has become a challenging research issue. Deliberate efforts have been attempted in this manuscript for finding a solution to this COVID-19 fake news detection problem with the help of deep learning models. Two deep learning models—BERT, a transfer learning model, and attention-based bi-directional long short-term memory (LSTM), a memory-based model, have been applied in order to get accurate fake news classification outcomes. A comparative outcome of both models is presented which shows BERT outperforms and gives excellent results in comparison to the attention-based bi-directional LSTM model. The achieved training accuracy by BERT is 86% which is much higher than the accuracy achieved by attention-based Bi-LSTM. BERT precision, recall, and F-score are 0.82, 0.79, and 0.80, respectively, which shows that BERT can detect COVID-19 fake news better than the attention-based Bi-LSTM model.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Patwa P, Bhardwaj M, Guptha V, Kumari G, Sharma S, Pykl S, Das A, Ekbal A, Akhtar MS, Chakraborty T (2021) Overview of constraint 2021 shared tasks: detecting English covid-19 fake news and Hindi hostile posts. In: International workshop on combating on line hostile posts in regional languages during emergency situation. Springer, Cham, pp 42–53
Paka WS, Bansal R, Kaushik A, Sengupta S, Chakraborty T (2021) Cross-SEAN: a cross-stitch semi-supervised neural attention model for COVID-19 fake news detection. Appl Soft Comput 107:107393
Jindal R, Dahiya D, Sinha D, Garg A (2022) A study of machine learning techniques for fake news detection and suggestion of an ensemble model. In: International conference on innovative computing and communications. Springer, Singapore, pp 627–637
Choudhary A, Arora A (2021) Linguistic feature based learning model for fake news detection and classification. Expert Syst Appl 169:114171
Singla M, Dutta M (2022) Deep classifier for news text classification using topic modeling approach. In: International conference on innovative computing and communications (pp 139–147). Springer, Singapore
Cao J, Guo J, Li X, Jin Z, Guo H, Li J (2018) Automatic rumor detection on microblogs: a survey. arXiv preprint arXiv:1807.03505.
Gravanis G, Vakali A, Diamantaras K, Karadais P (2019) Behind the cues: a benchmarking study for fake news detection. Expert Syst Appl 128:201–213
Su T, Macdonald C, Ounis I (2019) Ensembles of recurrent networks for classifying the relationship of fake news titles. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 893–896
Wu K, Yang S, Zhu KQ (2015) False rumors detection on sina weibo by propagation structures. In: 2015 IEEE 31st international conference on data engineering, IEEE, pp 651–662
Castillo, C., Mendoza, M., & Poblete, B. (2011, March). Information credibility on twitter. In Proceedings of the 20th international conference on world wide web, pp 675–684
Yang F, Liu Y, Yu X, Yang M (2012) Automatic detection of rumor on sina weibo. In: Proceedings of the ACM SIGKDD workshop on mining data semantics, pp 1–7
Kwon S, Cha M, Jung K, Chen W, Wang Y (2013). Prominent features of rumor propagation in online social media. In: 2013 IEEE 13th international conference on data mining, IEEE, pp 1103–1108
Yang Y, Niu K, He Z (2015) Exploiting the topology property of social network for rumor detection. In: 2015 12th international joint conference on computer science and software engineering (JCSSE), IEEE, pp 41–46
Chaudhary A, Mittal H, Arora A (2019) Anomaly detection using graph neural networks. In: 2019 international conference on machine learning, big data, cloud and parallel computing (COMITCon), (pp 346–350), IEEE
Giasemidis G, Singleton C, Agrafiotis I, Nurse JR, Pilgrim A, Willis C, Greetham DV (2016) Determining the veracity of rumours on Twitter. In: International conference on social informatics, Springer, Cham, pp 185–205
Kwon S, Cha M, Jung K (2017) Rumor detection over varying time windows. PLoS ONE 12(1):e0168344
Wang WY (2017) liar, liar pants on fire: a new benchmark dataset for fake news detection. arXiv preprint arXiv:1705.00648
Khanam Z, Alwasel BN, Sirafi H, Rashid M (2021) Fake news detection using machine learning approaches. In IOP conference series: materials science and engineering 1099(1):012040, IOP Publishing
Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781
Kaliyar RK, Goswami A, Narang P (2021) FakeBERT: Fake news detection in social media with a BERT-based deep learning approach. Multimedia Tools Appl 80(8):11765–11788
Devlin J, Chang MW, Lee K, Toutanova K (2018). Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805
Ma J, Gao W, Mitra P, Kwon S, Jansen BJ, Wong KF, Cha M (2016) Detecting rumors from microblogs with recurrent neural networks
Ruchansky N, Seo S, Liu Y (2017) Csi: a hybrid deep model for fake news detection. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 797–806
Khattar D, Goud JS, Gupta M, Varma V (2019) Mvae: multimodal variational autoencoder for fake news detection. In: the world wide web conference, pp 2915–2921
Agarwal A, Mittal M, Pathak A, Goyal LM (2020) Fake news detection using a blend of neural networks: an application of deep learning. SN Comput Sci 1(3):1–9
Tuan NMD, Minh PQN (2021). Multimodal fusion with BERT and attention mechanism for fake news detection. arXiv preprint arXiv:2104.11476
Jwa H, Oh D, Park K, Kang JM, Lim H (2019) Exbake: automatic fake news detection model based on bidirectional encoder representations from transformers (bert). Appl Sci 9(19):4062
Zhang T, Wang D, Chen H, Zeng Z, Guo W, Miao C, Cui L (2020) BDANN: BERT-based domain adaptation neural network for multi-modal fake news detection. In: 2020 international joint conference on neural networks (IJCNN), IEEE, pp 1–8
Srivastava Y, Khanna P, Kumar S (2022) COVID-19 spread: a demographic analysis. In: International conference on innovative computing and communications, Springer, Singapore, pp 497–507
Glazkova A, Glazkov M, Trifonov T (2021) g2tmn at constraint@ aaai2021: exploiting CT-BERT and ensembling learning for COVID-19 fake news detection. In: International workshop on combating on line hostile posts in regional languages during emergency situation. Springer, Cham, pp 116–127
Gundapu S, Mamidi R (2021) Transformer based automatic COVID-19 fake news detection system. arXiv preprint arXiv:2101.00180
Bang, Y., Ishii, E., Cahyawijaya, S., Ji, Z., & Fung, P. (2021). Model generalization on COVID-19 fake news detection. arXiv preprint arXiv:2101.03841.
Wani A, Joshi I, Khandve S, Wagh V, Joshi R (2021) Evaluating deep learning approaches for covid19 fake news detection. In: International workshop on combating on line hostile posts in regional languages during emergency situition, Springer, Cham, pp 153–163
Goyal A, Puri K, Jain R, Nagrath P (2022) Forecasting rate of spread of covid-19 using linear regression and LSTM. In: International conference on innovative computing and communications. Springer, Singapore, pp 123–134
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Choudhary, A., Arora, A. (2023). Comparative Analysis of Transfer Learning and Attention-driven Memory-based Learning for COVID-19 Fake News Detection. In: Gupta, D., Khanna, A., Bhattacharyya, S., Hassanien, A.E., Anand, S., Jaiswal, A. (eds) International Conference on Innovative Computing and Communications. Lecture Notes in Networks and Systems, vol 473. Springer, Singapore. https://doi.org/10.1007/978-981-19-2821-5_3
Download citation
DOI: https://doi.org/10.1007/978-981-19-2821-5_3
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-19-2820-8
Online ISBN: 978-981-19-2821-5
eBook Packages: EngineeringEngineering (R0)