Open Access iconOpen Access



Engagement Detection Based on Analyzing Micro Body Gestures Using 3D CNN

Shoroog Khenkar1,*, Salma Kammoun Jarraya1,2

1 Department of Computer Science, King Abdul-Aziz University, Jeddah, Saudi Arabia
2 MIRACL-Laboratory, Sfax, Tunisia

* Corresponding Author: Shoroog Khenkar. Email: email

(This article belongs to the Special Issue: Machine Learning Applications in Medical, Finance, Education and Cyber Security)

Computers, Materials & Continua 2022, 70(2), 2655-2677.


This paper proposes a novel, efficient and affordable approach to detect the students’ engagement levels in an e-learning environment by using webcams. Our method analyzes spatiotemporal features of e-learners’ micro body gestures, which will be mapped to emotions and appropriate engagement states. The proposed engagement detection model uses a three-dimensional convolutional neural network to analyze both temporal and spatial information across video frames. We follow a transfer learning approach by using the C3D model that was trained on the Sports-1M dataset. The adopted C3D model was used based on two different approaches; as a feature extractor with linear classifiers and a classifier after applying fine-tuning to the pre-trained model. Our model was tested and its performance was evaluated and compared to the existing models. It proved its effectiveness and superiority over the other existing methods with an accuracy of 94%. The results of this work will contribute to the development of smart and interactive e-learning systems with adaptive responses based on users’ engagement levels.


Cite This Article

APA Style
Khenkar, S., Jarraya, S.K. (2022). Engagement detection based on analyzing micro body gestures using 3D CNN. Computers, Materials & Continua, 70(2), 2655-2677.
Vancouver Style
Khenkar S, Jarraya SK. Engagement detection based on analyzing micro body gestures using 3D CNN. Comput Mater Contin. 2022;70(2):2655-2677
IEEE Style
S. Khenkar and S.K. Jarraya, "Engagement Detection Based on Analyzing Micro Body Gestures Using 3D CNN," Comput. Mater. Contin., vol. 70, no. 2, pp. 2655-2677. 2022.

cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 2015


  • 1333


  • 1


Share Link