Open Access iconOpen Access

ARTICLE

crossmark

A Deepfake Detection Algorithm Based on Fourier Transform of Biological Signal

Yin Ni1, Wu Zeng2,*, Peng Xia1, Guang Stanley Yang3, Ruochen Tan4

1 School of Electrical and Electronic Engineering, Wuhan Polytechnic University, Wuhan, 430023, China
2 School of Mathematics and Computer Science, Wuhan Polytechnic University, Wuhan, 430048, China
3 Paul G. Allen School of Computer Science and Engineering, University of Washington, Seattle, WA, 98195, USA
4 School of Computer Science and Engineering, University of California, SanDiego, CA, 92093, USA

* Corresponding Author: Wu Zeng. Email: email

(This article belongs to the Special Issue: Applications of Artificial Intelligence for Information Security)

Computers, Materials & Continua 2024, 79(3), 5295-5312. https://doi.org/10.32604/cmc.2024.049911

Abstract

Deepfake-generated fake faces, commonly utilized in identity-related activities such as political propaganda, celebrity impersonations, evidence forgery, and familiar fraud, pose new societal threats. Although current deepfake generators strive for high realism in visual effects, they do not replicate biometric signals indicative of cardiac activity. Addressing this gap, many researchers have developed detection methods focusing on biometric characteristics. These methods utilize classification networks to analyze both temporal and spectral domain features of the remote photoplethysmography (rPPG) signal, resulting in high detection accuracy. However, in the spectral analysis, existing approaches often only consider the power spectral density and neglect the amplitude spectrum—both crucial for assessing cardiac activity. We introduce a novel method that extracts rPPG signals from multiple regions of interest through remote photoplethysmography and processes them using Fast Fourier Transform (FFT). The resultant time-frequency domain signal samples are organized into matrices to create Matrix Visualization Heatmaps (MVHM), which are then utilized to train an image classification network. Additionally, we explored various combinations of time-frequency domain representations of rPPG signals and the impact of attention mechanisms. Our experimental results show that our algorithm achieves a remarkable detection accuracy of 99.22% in identifying fake videos, significantly outperforming mainstream algorithms and demonstrating the effectiveness of Fourier Transform and attention mechanisms in detecting fake faces.

Keywords


Cite This Article

APA Style
Ni, Y., Zeng, W., Xia, P., Yang, G.S., Tan, R. (2024). A deepfake detection algorithm based on fourier transform of biological signal. Computers, Materials & Continua, 79(3), 5295-5312. https://doi.org/10.32604/cmc.2024.049911
Vancouver Style
Ni Y, Zeng W, Xia P, Yang GS, Tan R. A deepfake detection algorithm based on fourier transform of biological signal. Comput Mater Contin. 2024;79(3):5295-5312 https://doi.org/10.32604/cmc.2024.049911
IEEE Style
Y. Ni, W. Zeng, P. Xia, G.S. Yang, and R. Tan "A Deepfake Detection Algorithm Based on Fourier Transform of Biological Signal," Comput. Mater. Contin., vol. 79, no. 3, pp. 5295-5312. 2024. https://doi.org/10.32604/cmc.2024.049911



cc This work is licensed under a Creative Commons Attribution 4.0 International License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
  • 119

    View

  • 73

    Download

  • 0

    Like

Share Link