Open Access iconOpen Access



Deep Bimodal Fusion Approach for Apparent Personality Analysis

Saman Riaz1, Ali Arshad2, Shahab S. Band3,*, Amir Mosavi4

1 Department of Computer Science, National University of Technology, Islamabad, 44000, Pakistan
2 Department of Computer Science, Institute of Space Technology, Islamabad, 44000, Pakistan
3 Future Technology Research Center, National Yunlin University of Science and Technology, Douliu, 64002, Yunlin, Taiwan
4 Faculty of Civil Engineering, Technische Universitat Dresden, Dresden, 01069, Germany

* Corresponding Author: Shahab S. Band. Email: email

Computers, Materials & Continua 2023, 75(1), 2301-2312.


Personality distinguishes individuals’ patterns of feeling, thinking, and behaving. Predicting personality from small video series is an exciting research area in computer vision. The majority of the existing research concludes preliminary results to get immense knowledge from visual and Audio (sound) modality. To overcome the deficiency, we proposed the Deep Bimodal Fusion (DBF) approach to predict five traits of personality-agreeableness, extraversion, openness, conscientiousness and neuroticism. In the proposed framework, regarding visual modality, the modified convolution neural networks (CNN), more specifically Descriptor Aggregator Model (DAN) are used to attain significant visual modality. The proposed model extracts audio representations for greater efficiency to construct the long short-term memory (LSTM) for the audio modality. Moreover, employing modality-based neural networks allows this framework to independently determine the traits before combining them with weighted fusion to achieve a conclusive prediction of the given traits. The proposed approach attains the optimal mean accuracy score, which is 0.9183. It is achieved based on the average of five personality traits and is thus better than previously proposed frameworks.


Cite This Article

APA Style
Riaz, S., Arshad, A., Band, S.S., Mosavi, A. (2023). Deep bimodal fusion approach for apparent personality analysis. Computers, Materials & Continua, 75(1), 2301-2312.
Vancouver Style
Riaz S, Arshad A, Band SS, Mosavi A. Deep bimodal fusion approach for apparent personality analysis. Comput Mater Contin. 2023;75(1):2301-2312
IEEE Style
S. Riaz, A. Arshad, S.S. Band, and A. Mosavi "Deep Bimodal Fusion Approach for Apparent Personality Analysis," Comput. Mater. Contin., vol. 75, no. 1, pp. 2301-2312. 2023.

cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 787


  • 350


  • 0


Share Link