Multimodal Signal Processing of ECG Signals with Time-Frequency Representations for Arrhythmia Classification

Yu Zhou¹, Jiawei Tian², Kyungtae Kang^3,*
1 Research Institute of AI Convergence, Hanyang University ERICA, Ansan, 15588, Republic of Korea
2 Department of Computer Science and Engineering, Hanyang University, Ansan, 15588, Republic of Korea
3 Department of Artificial Intelligence, Hanyang University, Ansan, 15588, Republic of Korea
* Corresponding Author: Kyungtae Kang. Email: email
(This article belongs to the Special Issue: Recent Advances in Signal Processing and Computer Vision)

Computer Modeling in Engineering & Sciences https://doi.org/10.32604/cmes.2026.077373

Received 08 December 2025; Accepted 15 January 2026; Published online 30 January 2026

Download PDF

Abstract

Arrhythmias are a frequently occurring phenomenon in clinical practice, but how to accurately distinguish subtle rhythm abnormalities remains an ongoing difficulty faced by the entire research community when conducting ECG-based studies. From a review of existing studies, two main factors appear to contribute to this problem: the uneven distribution of arrhythmia classes and the limited expressiveness of features learned by current models. To overcome these limitations, this study proposes a dual-path multimodal framework, termed DM-EHC (Dual-Path Multimodal ECG Heartbeat Classifier), for ECG-based heartbeat classification. The proposed framework links 1D ECG temporal features with 2D time–frequency features. By setting up the dual paths described above, the model can process more dimensions of feature information. The MIT-BIH arrhythmia database was selected as the baseline dataset for the experiments. Experimental results show that the proposed method outperforms single modalities and performs better for certain specific types of arrhythmias. The model achieved mean precision, recall, and F1 score of 95.14%, 92.26%, and 93.65%, respectively. These results indicate that the framework is robust and has potential value in automated arrhythmia classification.