Key Technologies and Typical Applications in Deepfake Detection
DOI:
https://doi.org/10.62051/xg2r2h35Keywords:
Information Tampering; Deepfake; Feature Extraction.Abstract
As deepfaking technology advances, it increasingly facilitates the seamless splicing of a person's voice, facial expressions, and body movements into source images or videos to create hyper-realistic virtual content. This growing technological sophistication, paired with the open-source nature of neural network algorithms, has unfortunately led to the exploitation of deepfake technology by individuals for illicit activities, seeking financial gain. This situation highlights the urgent necessity to thoroughly understand and vigilantly monitor the evolution of deepfake technology. This paper delves into the fundamental concepts and operational mechanisms underlying contemporary deepfake detection methods. It aims to augment the comprehension of these technologies and assesses the strengths and weaknesses of current detection approaches. This evaluation provides critical insights into their operational efficacy and reliability in differentiating genuine from manipulated content. Furthermore, the paper explores the challenges that current technologies face, such as the rapid evolution of deepfake methods that may outpace detection capabilities. By thoroughly analyzing these technologies, the paper endeavors to offer a comprehensive overview and projects future trends in deepfake detection. It anticipates developments that could significantly enhance the efficacy of countermeasures and thus bolster the fight against digital identity fraud and misinformation, safeguarding digital media integrity in an increasingly synthetic landscape.
Downloads
References
[1] H.Q. Zhao, T.Y. Wei, W.B. Zhou, et al., Multi-attentional deepfake detection, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, Nashville, USA, 2021, 2185-2194.
[2] L.Z. Li, J.M. Bao, T. Zhang, et al., Face X-ray for more general face forgery detection, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, Seattle, USA, 2020, 5000-5009.
[3] T.C. Zhao, X. Xu, M.Z. Xu, et al., Learning self-consistency for deepfake detection, Proceedings of the IEEE/CVF International Conference on Computer Vision, IEEE, Montreal, Canada, 2021, 15003-15013.
[4] K. Shiohara, T. Yamasaki, Detecting deepfakes with self-blended images, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, New Orleans, USA, 2022, 18699-18708.
[5] I.Masi, A. Killekar, R.M. Mascarenhas, et al., Two-branch current network for isolating deepfakes in videos, Proceedings of the 16th European Conference on Computer Vision, Springer, Glasgow, UK, 2020, 667-684.
[6] L. Ruff, N. G-Érnit, L. Deecke, et al., Deep one-class classification, Proceedings of the 35th International Conference on Machine Learning, PMLR, Stockholm, Sweden, 2018, 4390-4399.
[7] J.K. Wang, Z.X. Wu, W.H. Ouyang, et al., M2TR: Multi-modal multi-scale transformers for deepfake detection, Proceedings of the International Conference on Multimedia Retrieval, ACM, Newark, USA, 2022, 615-623.
[8] A.Haliassos, K. Vougioukas, S. Petridis, et al., Lips don’t lie: A generalizable and robust approach to face forgery detection, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, Nashville, USA, 2021, 5037-5047.
[9] J.S. Chung, A. Zisserman, Lip reading in the wild, Proceedings of the 13th Asian Conference on Computer Vision, Springer, Taipei, China, 2017, 87-103.
[10] K.M. He, X.Y. Zhang, S.Q. Ren, et al., Deep residual learning for image recognition, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, IEEE, Las Vegas, USA, 2016, 770-778.
[11] D. Tran, H. Wang, M. Feiszli, et al., Video classification with channel-separated volatile networks, Proceedings of the IEEE/CVF International Conference on Computer Vision, IEEE, Seoul, Korea (South), 2019, 5551-5560.
[12] L. Li, J. Bao, T. Zhang, et al., Face X-Ray for More General Face Forgery Detection, Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, IEEE, Seattle, WA, USA, 2020, 5000-5009, https://doi.org/10.1109/CVPR42600.2020.00505.
[13] Z. Shang, Research on Key Technologies of Video Face Depth Forgery Detection, Doctoral dissertation, University of Science and Technology of China, 2023, https://doi.org/10.27517.
[14] L.Yu, Summary of Deep Face Forgery and Detection Technology, Journal of Tsinghua University (Natural Science Edition), 63(09), 2023, 1350-1365.
Downloads
Published
Conference Proceedings Volume
Section
License

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.







