TY  - EJOU
AU  - Ding, Yuanqing 
AU  - Zhai, Hanming 
AU  - Ma, Qiming 
AU  - Zhang, Liang 
AU  - Shao, Lei 
AU  - Bu, Fanliang 

TI  - Face Forgery Detection via Multi-Scale Dual-Modality Mutual Enhancement Network
T2  - Computers, Materials \& Continua

PY  - 2025
VL  - 85
IS  - 1
SN  - 1546-2226

AB  - As the use of deepfake facial videos proliferate, the associated threats to social security and integrity cannot be overstated. Effective methods for detecting forged facial videos are thus urgently needed. While many deep learning-based facial forgery detection approaches show promise, they often fail to delve deeply into the complex relationships between image features and forgery indicators, limiting their effectiveness to specific forgery techniques. To address this challenge, we propose a dual-branch collaborative deepfake detection network. The network processes video frame images as input, where a specialized noise extraction module initially extracts the noise feature maps. Subsequently, the original facial images and corresponding noise maps are directed into two parallel feature extraction branches to concurrently learn texture and noise forgery clues. An attention mechanism is employed between the two branches to facilitate mutual guidance and enhancement of texture and noise features across four different scales. This dual-modal feature integration enhances sensitivity to forgery artifacts and boosts generalization ability across various forgery techniques. Features from both branches are then effectively combined and processed through a multi-layer perception layer to distinguish between real and forged video. Experimental results on benchmark deepfake detection datasets demonstrate that our approach outperforms existing state-of-the-art methods in terms of detection performance, accuracy, and generalization ability.
KW  - Face forgery detection; dual branch network; noise features; attention mechanism; multiple scale

DO  - 10.32604/cmc.2025.066307