Skip to main content

Comparative Analysis of Transfer Learning and Attention-driven Memory-based Learning for COVID-19 Fake News Detection

  • Conference paper
  • First Online:
International Conference on Innovative Computing and Communications

Abstract

In the pandemic COVID-19 situation, the world is facing a pandemic of fake information which often stirs the public attention by attacking their emotional quotient. Scenario reached a situation where people in search of worthy information for public health and precaution, getting fake news. This unprecedented expansion of fake information has become a challenging research issue. Deliberate efforts have been attempted in this manuscript for finding a solution to this COVID-19 fake news detection problem with the help of deep learning models. Two deep learning models—BERT, a transfer learning model, and attention-based bi-directional long short-term memory (LSTM), a memory-based model, have been applied in order to get accurate fake news classification outcomes. A comparative outcome of both models is presented which shows BERT outperforms and gives excellent results in comparison to the attention-based bi-directional LSTM model. The achieved training accuracy by BERT is 86% which is much higher than the accuracy achieved by attention-based Bi-LSTM. BERT precision, recall, and F-score are 0.82, 0.79, and 0.80, respectively, which shows that BERT can detect COVID-19 fake news better than the attention-based Bi-LSTM model.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    https://www.who.int/health-topics/infodemic.

  2. 2.

    https://www.businessinsider.com/77-phone-masts-fire-coronavirus-5g-conspiracy-theory-2020-5.

  3. 3.

    https://data.mendeley.com/datasets/zwfdmp5syg/1.

References

  1. Patwa P, Bhardwaj M, Guptha V, Kumari G, Sharma S, Pykl S, Das A, Ekbal A, Akhtar MS, Chakraborty T (2021) Overview of constraint 2021 shared tasks: detecting English covid-19 fake news and Hindi hostile posts. In: International workshop on combating on line hostile posts in regional languages during emergency situation. Springer, Cham, pp 42–53

    Google Scholar 

  2. Paka WS, Bansal R, Kaushik A, Sengupta S, Chakraborty T (2021) Cross-SEAN: a cross-stitch semi-supervised neural attention model for COVID-19 fake news detection. Appl Soft Comput 107:107393

    Article  Google Scholar 

  3. Jindal R, Dahiya D, Sinha D, Garg A (2022) A study of machine learning techniques for fake news detection and suggestion of an ensemble model. In: International conference on innovative computing and communications. Springer, Singapore, pp 627–637

    Google Scholar 

  4. Choudhary A, Arora A (2021) Linguistic feature based learning model for fake news detection and classification. Expert Syst Appl 169:114171

    Article  Google Scholar 

  5. Singla M, Dutta M (2022) Deep classifier for news text classification using topic modeling approach. In: International conference on innovative computing and communications (pp 139–147). Springer, Singapore

    Google Scholar 

  6. Cao J, Guo J, Li X, Jin Z, Guo H, Li J (2018) Automatic rumor detection on microblogs: a survey. arXiv preprint arXiv:1807.03505.

  7. Gravanis G, Vakali A, Diamantaras K, Karadais P (2019) Behind the cues: a benchmarking study for fake news detection. Expert Syst Appl 128:201–213

    Article  Google Scholar 

  8. Su T, Macdonald C, Ounis I (2019) Ensembles of recurrent networks for classifying the relationship of fake news titles. In: Proceedings of the 42nd international ACM SIGIR conference on research and development in information retrieval, pp 893–896

    Google Scholar 

  9. Wu K, Yang S, Zhu KQ (2015) False rumors detection on sina weibo by propagation structures. In: 2015 IEEE 31st international conference on data engineering, IEEE, pp 651–662

    Google Scholar 

  10. Castillo, C., Mendoza, M., & Poblete, B. (2011, March). Information credibility on twitter. In Proceedings of the 20th international conference on world wide web, pp 675–684

    Google Scholar 

  11. Yang F, Liu Y, Yu X, Yang M (2012) Automatic detection of rumor on sina weibo. In: Proceedings of the ACM SIGKDD workshop on mining data semantics, pp 1–7

    Google Scholar 

  12. Kwon S, Cha M, Jung K, Chen W, Wang Y (2013). Prominent features of rumor propagation in online social media. In: 2013 IEEE 13th international conference on data mining, IEEE, pp 1103–1108

    Google Scholar 

  13. Yang Y, Niu K, He Z (2015) Exploiting the topology property of social network for rumor detection. In: 2015 12th international joint conference on computer science and software engineering (JCSSE), IEEE, pp 41–46

    Google Scholar 

  14. Chaudhary A, Mittal H, Arora A (2019) Anomaly detection using graph neural networks. In: 2019 international conference on machine learning, big data, cloud and parallel computing (COMITCon), (pp 346–350), IEEE

    Google Scholar 

  15. Giasemidis G, Singleton C, Agrafiotis I, Nurse JR, Pilgrim A, Willis C, Greetham DV (2016) Determining the veracity of rumours on Twitter. In: International conference on social informatics, Springer, Cham, pp 185–205

    Google Scholar 

  16. Kwon S, Cha M, Jung K (2017) Rumor detection over varying time windows. PLoS ONE 12(1):e0168344

    Article  Google Scholar 

  17. Wang WY (2017) liar, liar pants on fire: a new benchmark dataset for fake news detection. arXiv preprint arXiv:1705.00648

  18. Khanam Z, Alwasel BN, Sirafi H, Rashid M (2021) Fake news detection using machine learning approaches. In IOP conference series: materials science and engineering 1099(1):012040, IOP Publishing

    Google Scholar 

  19. Mikolov T, Chen K, Corrado G, Dean J (2013) Efficient estimation of word representations in vector space. arXiv preprint arXiv:1301.3781

  20. Kaliyar RK, Goswami A, Narang P (2021) FakeBERT: Fake news detection in social media with a BERT-based deep learning approach. Multimedia Tools Appl 80(8):11765–11788

    Article  Google Scholar 

  21. Devlin J, Chang MW, Lee K, Toutanova K (2018). Bert: pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805

  22. Ma J, Gao W, Mitra P, Kwon S, Jansen BJ, Wong KF, Cha M (2016) Detecting rumors from microblogs with recurrent neural networks

    Google Scholar 

  23. Ruchansky N, Seo S, Liu Y (2017) Csi: a hybrid deep model for fake news detection. In: Proceedings of the 2017 ACM on conference on information and knowledge management, pp 797–806

    Google Scholar 

  24. Khattar D, Goud JS, Gupta M, Varma V (2019) Mvae: multimodal variational autoencoder for fake news detection. In: the world wide web conference, pp 2915–2921

    Google Scholar 

  25. Agarwal A, Mittal M, Pathak A, Goyal LM (2020) Fake news detection using a blend of neural networks: an application of deep learning. SN Comput Sci 1(3):1–9

    Article  Google Scholar 

  26. Tuan NMD, Minh PQN (2021). Multimodal fusion with BERT and attention mechanism for fake news detection. arXiv preprint arXiv:2104.11476

  27. Jwa H, Oh D, Park K, Kang JM, Lim H (2019) Exbake: automatic fake news detection model based on bidirectional encoder representations from transformers (bert). Appl Sci 9(19):4062

    Article  Google Scholar 

  28. Zhang T, Wang D, Chen H, Zeng Z, Guo W, Miao C, Cui L (2020) BDANN: BERT-based domain adaptation neural network for multi-modal fake news detection. In: 2020 international joint conference on neural networks (IJCNN), IEEE, pp 1–8

    Google Scholar 

  29. Srivastava Y, Khanna P, Kumar S (2022) COVID-19 spread: a demographic analysis. In: International conference on innovative computing and communications, Springer, Singapore, pp 497–507

    Google Scholar 

  30. Glazkova A, Glazkov M, Trifonov T (2021) g2tmn at constraint@ aaai2021: exploiting CT-BERT and ensembling learning for COVID-19 fake news detection. In: International workshop on combating on line hostile posts in regional languages during emergency situation. Springer, Cham, pp 116–127

    Google Scholar 

  31. Gundapu S, Mamidi R (2021) Transformer based automatic COVID-19 fake news detection system. arXiv preprint arXiv:2101.00180

  32. Bang, Y., Ishii, E., Cahyawijaya, S., Ji, Z., & Fung, P. (2021). Model generalization on COVID-19 fake news detection. arXiv preprint arXiv:2101.03841.

  33. Wani A, Joshi I, Khandve S, Wagh V, Joshi R (2021) Evaluating deep learning approaches for covid19 fake news detection. In: International workshop on combating on line hostile posts in regional languages during emergency situition, Springer, Cham, pp 153–163

    Google Scholar 

  34. Goyal A, Puri K, Jain R, Nagrath P (2022) Forecasting rate of spread of covid-19 using linear regression and LSTM. In: International conference on innovative computing and communications. Springer, Singapore, pp 123–134

    Google Scholar 

  35. https://data.mendeley.com/datasets/zwfdmp5syg/1

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anshika Choudhary .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Choudhary, A., Arora, A. (2023). Comparative Analysis of Transfer Learning and Attention-driven Memory-based Learning for COVID-19 Fake News Detection. In: Gupta, D., Khanna, A., Bhattacharyya, S., Hassanien, A.E., Anand, S., Jaiswal, A. (eds) International Conference on Innovative Computing and Communications. Lecture Notes in Networks and Systems, vol 473. Springer, Singapore. https://doi.org/10.1007/978-981-19-2821-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-2821-5_3

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-2820-8

  • Online ISBN: 978-981-19-2821-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics