Lanyu Shang
ABSTRACT
This paper focuses on a critical problem of explainable multimodal COVID-19 misinformation detection where the goal is to accurately detect misleading information in multimodal COVID-19 news articles and provide the reason or evidence that can explain the detection results. Our work is motivated by the lack of judicious study of the association between different modalities (e.g., text and image) of the COVID-19 news content in current solutions. In this paper, we present a generative approach to detect multimodal COVID-19 misinformation by investigating the cross-modal association between the visual and textual content that is deeply embedded in the multimodal news content. Two critical challenges exist in developing our solution: 1) how to accurately assess the consistency between the visual and textual content of a multimodal COVID-19 news article? 2) How to effectively retrieve useful information from the unreliable user comments to explain the misinformation detection results? To address the above challenges, we develop a duo-generative explainable misinformation detection (DGExplain) framework that explicitly explores the cross-modal association between the news content in different modalities and effectively exploits user comments to detect and explain misinformation in multimodal COVID-19 news articles. We evaluate DGExplain on two real-world multimodal COVID-19 news datasets. Evaluation results demonstrate that DGExplain significantly outperforms state-of-the-art baselines in terms of the accuracy of multimodal COVID-19 misinformation detection and the explainability of detection explanations.
- Firoj Alam, Stefano Cresci, Tanmoy Chakraborty, Fabrizio Silvestri, Dimiter Dimitrov, Giovanni Da San Martino, Shaden Shaar, Hamed Firooz, and Preslav Nakov. 2021. A Survey on Multimodal Disinformation Detection. arXiv preprint arXiv:2103.12541(2021).Google Scholar
- Talha Burki. 2020. The online anti-vaccine movement in the age of COVID-19. The Lancet Digital Health 2, 10 (2020), e504–e505.Google ScholarCross Ref
- Mingxuan Chen, Xinqiao Chu, and KP Subbalakshmi. 2021. MMCoVaR: Multimodal COVID-19 Vaccine Focused Data Repository for Fake News Detection and a Baseline Architecture for Classification. arXiv preprint arXiv:2109.06416(2021).Google Scholar
- Claudia Deane, Kim Parker, and John Gramlich. 2021. A year of U.S. public opinion on the coronavirus pandemic. https://www.pewresearch.org/2021/03/05/a-year-of-u-s-public-opinion-on-the-coronavirus-pandemic/Google Scholar
- Yashar Deldjoo, Tommaso Di Noia, and Felice Antonio Merra. 2021. A survey on adversarial recommender systems: from attack/defense strategies to generative adversarial networks. ACM Computing Surveys (CSUR) 54, 2 (2021), 1–38.Google ScholarDigital Library
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805(2018).Google Scholar
- Ross Girshick. 2015. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision. 1440–1448.Google ScholarDigital Library
- Han Guo, Juan Cao, Yazi Zhang, Junbo Guo, and Jintao Li. 2018. Rumor detection with hierarchical social attention network. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 943–951.Google ScholarDigital Library
- Liz Hamel, Lunna Lopes, Ashley Kirzinger, Grace Sparks, Mellisha Stokes, and Mollyann Brodie. 2021. KFF COVID-19 vaccine monitor: Media and misinformation. https://www.kff.org/coronavirus-covid-19/poll-finding/kff-covid-19-vaccine-monitor-media-and-misinformation/Google Scholar
- Silvan Heller, Luca Rossetto, and Heiko Schuldt. 2018. The ps-battles dataset-an image collection for image manipulation detection. arXiv preprint arXiv:1804.04866(2018).Google Scholar
- Benjamin D Horne, William Dron, Sara Khedr, and Sibel Adali. 2018. Assessing the news landscape: A multi-module toolkit for evaluating the credibility of news. In Companion Proceedings of the The Web Conference 2018. 235–238.Google ScholarDigital Library
- Dhruv Khattar, Jaipal Singh Goud, Manish Gupta, and Vasudeva Varma. 2019. Mvae: Multimodal variational autoencoder for fake news detection. In The World Wide Web Conference. 2915–2921.Google ScholarDigital Library
- Ziyi Kou, Lanyu Shang, Yang Zhang, and Dong Wang. 2022. HC-COVID: A Hierarchical Crowdsource Knowledge Graph Approach to Explainable COVID-19 Misinformation Detection. Proceedings of the ACM on Human-Computer Interaction 6, GROUP(2022), 1–25.Google ScholarDigital Library
- Ziyi Kou, Daniel Zhang, Lanyu Shang, and Dong Wang. 2021. What and Why Towards Duo Explainable Fauxtography Detection under Constrained Supervision. IEEE Transactions on Big Data(2021).Google ScholarCross Ref
- Ziyi Kou, Daniel Yue Zhang, Lanyu Shang, and Dong Wang. 2020. ExFaux: A Weakly Supervised Approach to Explainable Fauxtography Detection. In 2020 IEEE International Conference on Big Data (Big Data). IEEE, 631–636.Google ScholarCross Ref
- Leib Litman and Jonathan Robinson. 2020. Conducting online research on Amazon Mechanical Turk and beyond. Sage Publications.Google Scholar
- Yang Liu and Yi-Fang Wu. 2018. Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 32.Google ScholarCross Ref
- Jing Ma, Wei Gao, and Kam-Fai Wong. 2019. Detect rumors on twitter by promoting information campaigns with generative adversarial learning. In The World Wide Web Conference. 3049–3055.Google ScholarDigital Library
- Alexander Mathews, Lexing Xie, and Xuming He. 2018. Semstyle: Learning to generate stylised image captions using unaligned text. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 8591–8600.Google ScholarCross Ref
- Subhabrata Mukherjee, Gerhard Weikum, and Cristian Danescu-Niculescu-Mizil. 2014. People on drugs: credibility of user statements in health communities. In Proceedings of the 20th ACM SIGKDD international conference on Knowledge discovery and data mining. 65–74.Google ScholarDigital Library
- Kashyap Popat, Subhabrata Mukherjee, Jannik Strötgen, and Gerhard Weikum. 2018. CredEye: A credibility lens for analyzing and explaining misinformation. In Companion Proceedings of the The Web Conference 2018. 155–158.Google ScholarDigital Library
- Julio CS Reis, André Correia, Fabricio Murai, Adriano Veloso, and Fabrício Benevenuto. 2019. Explainable machine learning for fake news detection. In Proceedings of the 10th ACM conference on web science. 17–26.Google ScholarDigital Library
- Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2015. Faster r-cnn: Towards real-time object detection with region proposal networks. arXiv preprint arXiv:1506.01497(2015).Google Scholar
- Lanyu Shang, Ziyi Kou, Yang Zhang, and Dong Wang. 2021. A Multimodal Misinformation Detector for COVID-19 Short Videos on TikTok. In 2021 IEEE International Conference on Big Data (Big Data). IEEE, 899–908.Google ScholarCross Ref
- Lanyu Shang, Christina Youn, Yuheng Zha, Yang Zhang, and Dong Wang. 2021. KnowMeme: A Knowledge-enriched Graph Neural Network Solution to Offensive Meme Detection. In 2021 IEEE 17th International Conference on eScience (eScience). IEEE, 186–195.Google ScholarCross Ref
- Lanyu Shang, Yang Zhang, Yuheng Zha, Yingxi Chen, Christina Youn, and Dong Wang. 2021. Aomd: An analogy-aware approach to offensive meme detection on social media. Information Processing & Management 58, 5 (2021), 102664.Google ScholarDigital Library
- Lanyu Shang, Yang Zhang, Daniel Zhang, and Dong Wang. 2020. Fauxward: a graph neural network approach to fauxtography detection using social media comments. Social Network Analysis and Mining 10, 1 (2020), 1–16.Google ScholarCross Ref
- Elisa Shearer and Amy Mitchell. 2021. News use across social media platforms in 2020. (2021).Google Scholar
- Kai Shu, Limeng Cui, Suhang Wang, Dongwon Lee, and Huan Liu. 2019. defend: Explainable fake news detection. In Proceedings of the 25th ACM SIGKDD international conference on knowledge discovery & data mining. 395–405.Google ScholarDigital Library
- Shivangi Singhal, Rajiv Ratn Shah, Tanmoy Chakraborty, Ponnurangam Kumaraguru, and Shin’ichi Satoh. 2019. Spotfake: A multi-modal framework for fake news detection. In 2019 IEEE fifth international conference on multimedia big data (BigMM). IEEE, 39–47.Google Scholar
- Briony Swire-Thompson and David Lazer. 2019. Public health and online misinformation: Challenges and recommendations.Annual Review of Public Health 41 (2019), 433–451.Google Scholar
- Antonela Tommasel. 2019. Friend or foe: Studying user trustworthiness for friend recommendation in the era of misinformation. In 2019 IEEE second international conference on artificial intelligence and knowledge engineering (AIKE). IEEE, 273–276.Google Scholar
- Emily K Vraga and Leticia Bode. 2017. Using expert sources to correct health misinformation in social media. Science Communication 39, 5 (2017), 621–645.Google ScholarCross Ref
- Dong Wang, Md Tanvir Amin, Shen Li, Tarek Abdelzaher, Lance Kaplan, Siyu Gu, Chenji Pan, Hengchang Liu, Charu C Aggarwal, Raghu Ganti, 2014. Using humans as sensors: an estimation-theoretic perspective. In IPSN-14 proceedings of the 13th international symposium on information processing in sensor networks. IEEE, 35–46.Google ScholarCross Ref
- Dong Wang, Lance Kaplan, Hieu Le, and Tarek Abdelzaher. 2012. On truth discovery in social sensing: A maximum likelihood estimation approach. In Proceedings of the 11th international conference on Information Processing in Sensor Networks. 233–244.Google ScholarDigital Library
- Dong Wang, Boleslaw K Szymanski, Tarek Abdelzaher, Heng Ji, and Lance Kaplan. 2019. The age of social sensing. Computer 52, 1 (2019), 36–45.Google ScholarDigital Library
- Yaqing Wang, Fenglong Ma, Zhiwei Jin, Ye Yuan, Guangxu Xun, Kishlay Jha, Lu Su, and Jing Gao. 2018. Eann: Event adversarial neural networks for multi-modal fake news detection. In Proceedings of the 24th acm sigkdd international conference on knowledge discovery & data mining. 849–857.Google ScholarDigital Library
- Yuta Yanagi, Ryohei Orihara, Yuichi Sei, Yasuyuki Tahara, and Akihiko Ohsuga. 2020. Fake News Detection with Generated Comments for News Articles. In 2020 IEEE 24th International Conference on Intelligent Engineering Systems (INES). IEEE, 85–90.Google Scholar
- Fan Yang, Shiva K Pentyala, Sina Mohseni, Mengnan Du, Hao Yuan, Rhema Linder, Eric D Ragan, Shuiwang Ji, and Xia Hu. 2019. Xfake: Explainable fake news detector with visualizations. In The World Wide Web Conference. 3600–3604.Google ScholarDigital Library
- Rowan Zellers, Ari Holtzman, Hannah Rashkin, Yonatan Bisk, Ali Farhadi, Franziska Roesner, and Yejin Choi. 2019. Defending against neural fake news. arXiv preprint arXiv:1905.12616(2019).Google Scholar
- Daniel Yue Zhang, Lanyu Shang, Biao Geng, Shuyue Lai, Ke Li, Hongmin Zhu, Md Tanvir Amin, and Dong Wang. 2018. Fauxbuster: A content-free fauxtography detector using social media comments. In 2018 IEEE International Conference on Big Data (Big Data). IEEE, 891–900.Google ScholarCross Ref
- Lu Zhang, Jianming Zhang, Zhe Lin, Huchuan Lu, and You He. 2019. Capsal: Leveraging captioning to boost semantics for salient object detection. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6024–6033.Google ScholarCross Ref
- Wenjia Zhang, Lin Gui, and Yulan He. 2021. Supervised Contrastive Learning for Multimodal Unreliable News Detection in COVID-19 Pandemic. arXiv preprint arXiv:2109.01850(2021).Google Scholar
- Wei Emma Zhang, Quan Z Sheng, Ahoud Alhazmi, and Chenliang Li. 2020. Adversarial attacks on deep-learning models in natural language processing: A survey. ACM Transactions on Intelligent Systems and Technology (TIST) 11, 3(2020), 1–41.Google ScholarDigital Library
- Yang Zhang, Xiangyu Dong, Md Tahmid Rashid, Lanyu Shang, Jun Han, Daniel Zhang, and Dong Wang. 2020. Pqa-cnn: Towards perceptual quality assured single-image super-resolution in remote sensing. In 2020 IEEE/ACM 28th International Symposium on Quality of Service (IWQoS). IEEE, 1–10.Google ScholarCross Ref
- Zhilu Zhang and Mert R Sabuncu. 2018. Generalized cross entropy loss for training deep neural networks with noisy labels. In 32nd Conference on Neural Information Processing Systems (NeurIPS).Google ScholarDigital Library
- Xinyi Zhou, Apurva Mulay, Emilio Ferrara, and Reza Zafarani. 2020. Recovery: A multimodal repository for covid-19 news credibility research. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management.Google ScholarDigital Library
- Xinyi Zhou, Jindi Wu, and Reza Zafarani. 2020. SAFE: Similarity-Aware Multi-modal Fake News Detection. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 354–367.Google Scholar
Index Terms
- A Duo-generative Approach to Explainable Multimodal COVID-19 Misinformation Detection
Index terms have been assigned to the content through auto-classification.
Recommendations
Are Mutated Misinformation More Contagious? A Case Study of COVID-19 Misinformation on Twitter
WebSci '22: Proceedings of the 14th ACM Web Science Conference 2022The spread of online misinformation has become a major global risk. Understanding how misinformation propagates on social media is vital. While prior studies suggest that the content factors, such as emotion and topic in texts, are closely related to the ...
Co-spread of Misinformation and Fact-Checking Content During the Covid-19 Pandemic
Social InformaticsAbstractIn the context of the Covid-19 pandemic, the consequences of misinformation are a matter of life and death. Correcting misconceptions and false beliefs are important for injecting reliable information about the outbreak. Fact-checking ...
Demographics and topics impact on the co-spread of COVID-19 misinformation and fact-checks on Twitter
AbstractCorrecting misconceptions and false beliefs are important for injecting reliable information about COVID-19 into public discourse, but what impact does this have on the continued proliferation of misinforming claims? Fact-checking ...
Highlights- The relation between misinformation and fact-checking during COVID-19 is studied.
Comments