Submit

Login Login

Register Register

Home / Journals / CMC / Online First / doi:10.32604/cmc.2026.084057
Journal Menu
Special Issues
Table of Content

All issues

Online First

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

Open Access

ARTICLE

Data Mining and Uncertainty-Aware with Missing Modalities for Multimodal Sentiment Analysis

Ying Cao1, Penghui Zhao1, Xinyu Qiao1, Ningfan Zhan1, Xiaomei Zou2,*
1 School of Computer and Information Engineering, Henan University, Kaifeng, China
2 Research Center for High Efficiency Computing Infrastructure, Zhejiang Lab, Hangzhou, China
* Corresponding Author: Xiaomei Zou. Email: email

Computers, Materials & Continua https://doi.org/10.32604/cmc.2026.084057

Received 15 April 2026; Accepted 15 May 2026; Published online 08 June 2026

Abstract

Multimodal Sentiment Analysis (MSA) integrates diverse modalities to identify emotional states, yet performance often suffers in scenarios with missing data. In this situation, despite the promising results of recent methods, the failure of part methods to fully exploit the latent valid information contained in incomplete modalities may degrade predictive performance. Besides, to address the oversight of varying contributions across modalities to sentiment understanding, the score-based weighting schemes in the exhibited methods remain overly sensitive to data fluctuations, leading to unstable and unreliable predictions. To this end, we propose a novel method, Data Mining and Uncertainty-Aware with Missing Modalities for Multimodal Sentiment Analysis (DUDF-MSA). In this method, the Common Feature Extraction (CFE) mechanism is introduced to learn common features across modalities, thereby guiding attention toward critical cues in the missing modalities. In parallel, the specific feature uncertainty-aware dynamic adjustment (SFUA) scheme is designed to, in addition to extracting modality-specific features, adaptively assess each modality’s contribution by quantifying its class uncertainty based on the probability distribution of its features. According to these weights, our method can effectively mitigate the negative impact of ambiguous sentiment cues from unreliable modalities during the following feature aggregation stage. Finally, the common features and the adjusted modality-specific features are jointly learned to predict sentiment intensity. The experiments conducted on benchmark datasets indicate the superior performance of DUDF-MSA, which yielding 34.29% Acc-7 (1.062 MAE) on MOSI and 35.66% Acc-5 (0.505 MAE) on SIMS.

Keywords

Multimodal sentiment analysis; missing modalities; common features extraction; specific feature uncertainty-aware dynamic adjustment

  • 52

    View

  • 8

    Download

  • 0

    Like

Related articles
Copyright© 2026 Tech Science Press
© 1997-2026 TSP (Henderson, USA) unless otherwise stated

Share Link