TY - EJOU
AU - Khan, Mustaqeem
AU - Khan, Ufaq
AU - Awad, Mamoun
AU - Zaki, Nazar
AU - Son, Guiyoung
AU - Kwon, Soonil
TI - Real-Time Emotion Recognition System Using Adaptive Distillation Technique
T2 - Computer Modeling in Engineering \& Sciences
PY - 2026
VL - 147
IS - 1
SN - 1526-1506
AB - Knowledge distillation has shown impressive results in different fields, including detection, recognition, and generation. These models are excellent at tasks such as speech recognition, but they need to be shrunk down using adaptive knowledge distillation (AKD). The use of AKD can improve human-computer interactions and streamline data collection in the field of Speech Emotion Recognition (SER). This study presents a high-level approach that employs a novel adaptive knowledge distillation (AKD) with spatio-temporal transformers to acquire advanced semantic features from the input signal. This method uses an instance-by-instance correlation between the teacher and a student to determine the teacher’s importance. Additionally, this work proposes a knowledge-transfer strategy to integrate soft targets between teachers and students, aiming to provide deeper insight for the final prediction. Our light-weight model AKD is an efficient solution for edge devices and learns the synergistic information for respective tasks, as discussed in the results and analysis section. Our proposed model AKD outperforms the SOTA models of SER systems on the benchmark datasets, IEMOCAP, EmoDB, and RAVDESS, with an absolute gain of 4%–6% in overall recognition rate.
KW - Affective computing; edge electronics; emotion recognition; knowledge distillation; speech signal
DO - 10.32604/cmes.2026.079697