Open Access iconOpen Access

ARTICLE

crossmark

Fake News Detection Based on Multimodal Inputs

Zhiping Liang*

Unversity of Melbourne, Melbourne, VIC 3010, Australia

* Corresponding Author: Zhiping Liang. Email: email

Computers, Materials & Continua 2023, 75(2), 4519-4534. https://doi.org/10.32604/cmc.2023.037035

Abstract

In view of the various adverse effects, fake news detection has become an extremely important task. So far, many detection methods have been proposed, but these methods still have some limitations. For example, only two independently encoded unimodal information are concatenated together, but not integrated with multimodal information to complete the complementary information, and to obtain the correlated information in the news content. This simple fusion approach may lead to the omission of some information and bring some interference to the model. To solve the above problems, this paper proposes the Fake News Detection model based on BLIP (FNDB). First, the XLNet and VGG-19 based feature extractors are used to extract textual and visual feature representation respectively, and BLIP based multimodal feature extractor to obtain multimodal feature representation in news content. Then, the feature fusion layer will fuse these features with the help of the cross-modal attention module to promote various modal feature representations for information complementation. The fake news detector uses these fused features to identify the input content, and finally complete fake news detection. Based on this design, FNDB can extract as much information as possible from the news content and fuse the information between multiple modalities effectively. The fake news detector in the FNDB can also learn more information to achieve better performance. The verification experiments on Weibo and Gossipcop, two widely used real-world datasets, show that FNDB is 4.4% and 0.6% higher in accuracy than the state-of-the-art fake news detection methods, respectively.

Keywords


Cite This Article

APA Style
Liang, Z. (2023). Fake news detection based on multimodal inputs. Computers, Materials & Continua, 75(2), 4519-4534. https://doi.org/10.32604/cmc.2023.037035
Vancouver Style
Liang Z. Fake news detection based on multimodal inputs. Comput Mater Contin. 2023;75(2):4519-4534 https://doi.org/10.32604/cmc.2023.037035
IEEE Style
Z. Liang, "Fake News Detection Based on Multimodal Inputs," Comput. Mater. Contin., vol. 75, no. 2, pp. 4519-4534. 2023. https://doi.org/10.32604/cmc.2023.037035



cc Copyright © 2023 The Author(s). Published by Tech Science Press.
This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 893

    View

  • 426

    Download

  • 0

    Like

Share Link