Israa K. Salman Al-Tameemi^1,3, Mohammad-Reza Feizi-Derakhshi^1,*, Saeed Pashazadeh², Mohammad Asadpour²

CMC-Computers, Materials & Continua, Vol.76, No.2, pp. 2145-2177, 2023, DOI:10.32604/cmc.2023.040997

Abstract Multimodal Sentiment Analysis (SA) is gaining popularity due to its broad application potential. The existing studies have focused on the SA of single modalities, such as texts or photos, posing challenges in effectively handling social media data with multiple modalities. Moreover, most multimodal research has concentrated on merely combining the two modalities rather than exploring their complex correlations, leading to unsatisfactory sentiment classification results. Motivated by this, we propose a new visual-textual sentiment classification model named Multi-Model Fusion (MMF), which uses a mixed fusion framework for SA to effectively capture the essential information and the intrinsic relationship between the visual… More >

Jieyu An^*, Wan Mohd Nazmee Wan Zainon, Zhang Hao

CMC-Computers, Materials & Continua, Vol.75, No.3, pp. 5801-5815, 2023, DOI:10.32604/cmc.2023.038220

Abstract Targeted multimodal sentiment classification (TMSC) aims to identify the sentiment polarity of a target mentioned in a multimodal post. The majority of current studies on this task focus on mapping the image and the text to a high-dimensional space in order to obtain and fuse implicit representations, ignoring the rich semantic information contained in the images and not taking into account the contribution of the visual modality in the multimodal fusion representation, which can potentially influence the results of TMSC tasks. This paper proposes a general model for Improving Targeted Multimodal Sentiment Classification with Semantic Description of Images (ITMSC) as… More >