TY  - EJOU
AU  - Fu, Lifang 
AU  - Peng, Huanxin 
AU  - Ma, Changjin 
AU  - Liu, Yuhan 

TI  - Fake News Detection Based on Text-Modal Dominance and Fusing Multiple Multi-Model Clues
T2  - Computers, Materials \& Continua

PY  - 2024
VL  - 78
IS  - 3
SN  - 1546-2226

AB  - In recent years, how to efficiently and accurately identify multi-model fake news has become more challenging. First, multi-model data provides more evidence but not all are equally important. Secondly, social structure information has proven to be effective in fake news detection and how to combine it while reducing the noise information is critical. Unfortunately, existing approaches fail to handle these problems. This paper proposes a multi-model fake news detection framework based on Tex-modal Dominance and fusing Multiple Multi-model Cues (TD-MMC), which utilizes three valuable multi-model clues: text-model importance, text-image complementary, and text-image inconsistency. TD-MMC is dominated by textural content and assisted by image information while using social network information to enhance text representation. To reduce the irrelevant social structure’s information interference, we use a unidirectional cross-modal attention mechanism to selectively learn the social structure’s features. A cross-modal attention mechanism is adopted to obtain text-image cross-modal features while retaining textual features to reduce the loss of important information. In addition, TD-MMC employs a new multi-model loss to improve the model’s generalization ability. Extensive experiments have been conducted on two public real-world English and Chinese datasets, and the results show that our proposed model outperforms the state-of-the-art methods on classification evaluation metrics.
KW  - Fake news detection; cross-modal attention mechanism; multi-modal fusion; social network; transfer learning

DO  - 10.32604/cmc.2024.047053